-- Logs begin at Mon 2022-07-18 09:41:51 UTC, end at Mon 2022-07-18 11:05:19 UTC. -- Jul 18 10:36:38.927379 dv-cinder-849498-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 10:36:38.937699 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 10:36:38.939429 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 10:36:38 2022] *** Jul 18 10:36:38.939429 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 10:36:38.939429 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 10:36:38.939429 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: nodename: dv-cinder-849498-1-iscsi Jul 18 10:36:38.939429 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: machine: x86_64 Jul 18 10:36:38.939429 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: clock source: unix Jul 18 10:36:38.939429 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: pcre jit disabled Jul 18 10:36:38.939429 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: detected number of CPU cores: 4 Jul 18 10:36:38.939429 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: current working directory: / Jul 18 10:36:38.939429 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: detected binary path: /usr/bin/uwsgi-core Jul 18 10:36:38.940120 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: your processes number limit is 47680 Jul 18 10:36:38.940120 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: your memory page size is 4096 bytes Jul 18 10:36:38.940120 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: detected max file descriptor number: 2048 Jul 18 10:36:38.940120 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: lock engine: pthread robust mutexes Jul 18 10:36:38.940120 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: thunder lock: enabled Jul 18 10:36:38.940120 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 10:36:38.940120 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 10:36:38.979903 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: Python main interpreter initialized at 0x55d5b340a9c0 Jul 18 10:36:38.979903 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: python threads support enabled Jul 18 10:36:38.979903 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: your server socket listen backlog is limited to 100 connections Jul 18 10:36:38.979903 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: your mercy for graceful operations on workers is 90 seconds Jul 18 10:36:38.980321 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 10:36:38.980321 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: *** Operational MODE: preforking *** Jul 18 10:36:38.980592 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: *** uWSGI is running in multiple interpreter mode *** Jul 18 10:36:38.980592 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: spawned uWSGI master process (pid: 110403) Jul 18 10:36:38.980839 dv-cinder-849498-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 10:36:38.982978 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: spawned uWSGI worker 1 (pid: 110404, cores: 1) Jul 18 10:36:38.982978 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: spawned uWSGI worker 2 (pid: 110405, cores: 1) Jul 18 10:36:38.982978 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 10:36:39.657718 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 10:36:39.659886 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 10:36:40.770223 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:36:40.770223 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: from cryptography.utils import int_from_bytes Jul 18 10:36:40.770898 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:36:40.770898 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: from cryptography.utils import int_from_bytes Jul 18 10:36:40.780027 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:36:40.780027 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: from cryptography.utils import int_from_bytes Jul 18 10:36:40.780517 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:36:40.780517 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: from cryptography.utils import int_from_bytes Jul 18 10:36:43.309267 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:36:43.309934 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:36:43.310113 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:36:43.310450 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:36:43.310527 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:36:43.310601 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:36:43.310669 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:36:43.310740 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:36:43.311015 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.311111 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:36:43.311340 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.311425 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:36:43.311665 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.311760 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.311989 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.312084 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.312323 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.312411 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.312641 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.312746 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.312991 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.313078 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.313306 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.313399 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.313631 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.313716 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.313892 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.313976 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.314209 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.314304 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.314513 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.314606 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849498-1-iscsi {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.314832 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.314938 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.315145 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.315259 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849498-1-iscsi {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.315460 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.315560 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.315764 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.315846 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.316073 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.316163 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.316390 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.316474 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.316696 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.316808 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.317041 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.317217 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.317360 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.317668 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.317868 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.317989 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.318195 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.318299 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.318488 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.318628 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.318822 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.319045 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.319239 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.319396 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.319571 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.319779 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.319970 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.320248 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.320519 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.320751 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.320751 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.321129 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.321314 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849498-1-iscsi {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.321503 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.321503 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.321825 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.321825 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.322165 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849498-1-iscsi {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.322348 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.322529 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.322529 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.322872 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.323045 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.323265 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.323265 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.323568 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.323704 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.323851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.323851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.324076 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.324225 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.324349 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.324468 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.324586 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.324713 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.324890 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.325015 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.325142 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.325262 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.325389 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.325509 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.325640 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.325760 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.325879 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.325997 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.326150 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.326325 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.326464 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.326586 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.326705 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.326874 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.326998 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.327125 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.327254 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.327416 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.327541 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.327706 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.327829 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.328014 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.328147 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.328337 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.328468 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.328593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.328712 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.328928 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.329099 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.329229 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.329350 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.329477 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.329608 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.329772 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.329896 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.330082 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.330206 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.330386 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.330510 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.330692 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.330825 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.330996 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.331125 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.331301 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.331430 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.331606 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.331729 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.331912 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.332034 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.332215 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.332338 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.332522 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.332646 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.332862 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.333002 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.333174 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.333296 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.333493 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.333614 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.333801 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.333932 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.334119 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.334244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.334426 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.334547 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.334750 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.334882 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.335057 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.335189 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.335370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.335492 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.335691 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.335893 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.336016 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.336118 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.336329 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.336493 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.336649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.336827 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.336983 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.337131 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.337292 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.337456 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.337590 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.337795 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.337922 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.338103 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.338234 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.338355 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.338516 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.338640 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.338760 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.338941 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.339072 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.339263 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.339395 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.339573 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.339704 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.339882 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.340007 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.340192 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.340328 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.340494 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.340705 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.340843 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.340963 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.341120 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.341260 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.341431 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.341563 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.341738 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.341867 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.342044 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.342176 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.342347 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.342470 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.342650 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.342774 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.342955 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.343079 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.343258 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.343389 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.343563 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.343687 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.343882 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.344008 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.344187 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.344311 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.344491 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.344621 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.344811 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.344939 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.345123 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.345267 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.345428 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.345554 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.345737 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.345869 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.346041 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.346164 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.346348 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.346473 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.346655 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.346779 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.346959 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.347088 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.347266 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.347392 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.347573 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.347704 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.347876 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.348007 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.348181 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.348317 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.348480 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.348611 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.348799 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.348937 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.349109 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.349235 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.349416 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.349540 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.349718 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.349851 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.350022 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.350153 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.350322 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.350446 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.350626 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.350758 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.350929 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.351062 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.351230 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.351870 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.352076 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.352244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.352374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.352486 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.352645 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.352800 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.352995 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.353120 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.353308 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.353451 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.353616 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.353741 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.353924 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.354048 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.354251 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.354391 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.354591 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.354716 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:36:43.354924 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.355049 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.355257 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.355388 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.355575 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.355698 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.356164 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.356291 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.356497 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.356621 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.356845 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.356989 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.357165 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.357316 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.357483 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.357615 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.357812 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.357946 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.358127 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.358260 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.358440 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.358563 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.358754 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.358887 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.359065 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.359197 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.359383 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.359505 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.359733 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.359871 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.360020 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.360151 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.360335 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.360458 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.360652 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.360787 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.360995 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.361129 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.361310 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.361447 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.361629 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.361754 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.361949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.362080 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.362264 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.362387 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.362574 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.362697 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.362916 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.363050 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.363240 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.363373 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.363563 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.363695 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.363887 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.364010 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.364205 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.364328 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.364517 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.364640 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.364847 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.364975 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.365162 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.365287 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.365487 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.365613 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.365808 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.365943 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.366120 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.366244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.366433 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.366565 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.366743 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.366873 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.367127 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.367773 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.367954 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.368178 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.368303 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.368566 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.368690 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.368946 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.369073 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.369267 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.369401 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.369585 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.369711 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.369899 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.370025 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.370219 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.370348 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.370535 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.370660 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.370849 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.370974 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.371163 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.371292 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.371473 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.371610 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.371782 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.371915 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.372090 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.372215 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.372404 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.372531 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.372711 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.372899 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.373064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.373188 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.373401 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.373524 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.373708 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.373842 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.374046 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.374171 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.374354 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.374480 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.374669 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.374807 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.374984 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.375107 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.375295 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.375426 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.375603 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.375728 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.375914 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.376037 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.376228 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.376351 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.376532 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.376666 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.376880 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.377007 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.377197 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.377323 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.377496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.377712 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.377838 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.377961 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.378117 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.378250 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.378426 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.378552 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.378746 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.378870 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.379061 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.379195 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.379372 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.379497 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.379688 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.379812 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.380001 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.380139 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.380328 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.380462 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.380643 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.380851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.380990 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.381111 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.381310 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.381436 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.381647 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.381782 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.381957 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.382094 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.382281 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.382406 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.382608 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.382753 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.382960 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.383088 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.383271 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.383461 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.383573 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.383786 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.384077 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.384212 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.384394 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.384520 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.384701 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.384857 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.385039 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.385173 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.385346 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.385470 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.385651 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.385775 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.385960 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.386097 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.386263 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.386387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.386568 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.386700 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.386894 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.387023 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.387207 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.387332 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.387512 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.387714 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.387839 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.387959 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.388109 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.388242 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.388458 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.388594 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.388765 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.388967 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.389135 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.389266 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.389473 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.389606 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.389794 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.389917 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.390119 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.390243 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.390431 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.390563 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.390751 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.390874 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.391062 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.391179 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.391377 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.391501 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.391689 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.391820 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.392002 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.392125 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.392322 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.392440 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.392635 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.392758 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.392981 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.393106 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.393296 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.393424 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.393620 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.393744 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.393932 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.394056 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.394253 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.394378 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.394559 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.394685 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.394877 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.395011 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.395219 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.395343 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.395551 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.395676 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.395872 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.396004 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.396195 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.396318 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.396506 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.396631 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.396849 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.396995 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.397166 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.397291 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.397480 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.397611 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.397792 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.397925 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.398104 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.398261 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.398468 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.398622 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.398846 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.399006 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.399272 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.399425 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.399667 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.399791 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.399913 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.400032 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.400206 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.400332 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.400529 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.400654 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.400860 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.401002 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.401181 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.401300 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.401517 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.401643 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.401853 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.401979 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.402166 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.402289 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.402480 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.402619 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.402803 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.402928 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.403114 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.403239 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.403426 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.403560 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.403736 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.403869 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.404044 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.404167 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.404348 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.404485 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.404660 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.404811 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.405001 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.405126 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.405343 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.405491 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.405615 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.405734 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.405915 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.406042 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.406230 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.406362 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.406539 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.406663 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.406845 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.406969 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.407152 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.407277 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.407467 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.407583 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.407796 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.407921 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.408108 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.408234 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.408432 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.408564 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.408754 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.408902 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.409089 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.409223 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.409392 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.409516 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.409718 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.409849 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.410026 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.410150 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.410331 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.410456 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.410637 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.410775 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.410944 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.411068 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.411291 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.411418 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.411604 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.411743 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.411911 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.412035 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.412227 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.412352 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.412550 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.412683 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.412887 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.413014 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.413209 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.413332 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.413520 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.413656 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.413831 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.414667 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.414796 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.415001 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.415134 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.415286 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.415459 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.415703 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.415828 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.415949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.416079 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.416200 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.416329 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.416506 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.416633 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.416856 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.417003 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.417176 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.417303 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.417491 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.417625 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.417806 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.418014 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.418145 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.418266 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.418412 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.418544 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.418726 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.418854 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.419046 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.419314 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.419620 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.419753 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.419958 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.420092 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.420275 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.420409 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.420596 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.420721 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.420947 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.421070 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.421250 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.421376 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.421584 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.421724 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.421913 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.422039 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.422257 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.422398 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.422567 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.422694 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.422881 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.423007 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.423185 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.423310 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.423494 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.423619 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.423799 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.423925 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.424103 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.424228 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.424411 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.424545 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.424716 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.424862 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.425052 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.425177 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.425356 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.425479 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.425660 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.425800 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.425962 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.426087 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.426265 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.426391 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.426572 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.426709 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.426872 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.426997 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.427183 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.427315 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.427486 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.427619 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.427811 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.427931 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.428115 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.428247 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.428417 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.428551 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.428720 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.428922 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.429044 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.429166 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.429383 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.429716 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.430409 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.430588 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.430748 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.430873 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.430987 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.431092 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.431233 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.431369 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.431544 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.431670 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.431872 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.431998 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.432181 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.432317 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.432488 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.432622 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.432812 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.432936 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.433134 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.433260 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.433449 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.433589 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.433755 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.433881 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.434057 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.434183 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.434372 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.434512 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.434684 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.434810 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.434993 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.435118 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.435301 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.435436 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.435601 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.435726 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.435908 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.436033 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.436210 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.436335 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.436528 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.436653 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.436861 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.436987 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.437171 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.437298 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.437477 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.437604 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.437788 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.437912 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.438098 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.438226 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.438402 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.438536 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.438710 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.438835 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.439013 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.439146 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.439325 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.439449 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.439629 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.439773 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.439934 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.440058 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.440255 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.440388 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.440547 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.440686 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.441029 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.441165 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.441165 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.441395 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.441523 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.441798 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.442087 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.442214 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.442345 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.442477 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.442607 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.442813 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.442939 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.443057 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.443189 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.443320 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.443441 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.443570 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.443691 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.443813 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.443933 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.444053 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.444181 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.444303 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.444449 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.444575 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.444763 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.444928 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.445092 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.445219 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.445432 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.445560 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.445740 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.445854 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.446052 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.446137 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.446399 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.446524 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.446706 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.446850 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.447012 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.447138 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.447318 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.447443 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.447645 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.447780 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.447959 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.448084 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.448268 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.448391 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.448574 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.448706 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.448886 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.449008 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.449196 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.449338 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.449544 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.449677 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.449849 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.449974 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.450202 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.450326 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.450504 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.450622 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.450820 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.450945 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.451135 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.451263 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.451448 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.451573 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.451763 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.451889 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.452066 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.452205 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.452369 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.452502 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.452686 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.452829 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.453021 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.453139 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.453327 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.453452 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.453635 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.453766 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.453941 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.454067 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.454263 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.454389 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.454571 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.454696 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.454883 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.455022 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.455273 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.455446 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.455575 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.455696 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.455816 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.456091 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.456199 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.456319 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.456450 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.456578 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.456700 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.456857 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.457098 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.457233 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.457354 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.457476 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.457626 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.457764 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.457938 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.458064 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.458249 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.458374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.458560 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.458684 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.458869 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.458992 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.459173 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.459296 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.459477 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.459602 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.459863 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.460003 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.460125 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.460253 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.460383 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.460504 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.460690 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.460864 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.461190 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.461329 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.461579 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.461788 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.461909 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.462054 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.462178 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.462307 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.462489 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.462614 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.462795 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.462919 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.463234 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.463368 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.463545 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.463669 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.463857 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.463981 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.464163 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.464289 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.464475 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.464600 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.464872 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.465004 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.465125 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.465259 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.465425 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.465550 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.465729 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.465855 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.466149 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.466271 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.466462 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.466586 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.466773 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.466907 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.467079 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.467204 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.467381 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.467505 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.467685 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.467812 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.467997 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.468123 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.468301 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.468418 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.468606 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.468732 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.468933 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.469060 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.469238 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.469364 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.469578 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.469719 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.469842 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.469969 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.470166 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.470300 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.470592 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.470725 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.470904 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.471029 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.471209 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.471334 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.471625 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.471839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.471963 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.472083 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.472213 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.472343 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.472539 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.472674 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.472886 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.473015 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.473195 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.473330 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.473510 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.473644 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.473823 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.473956 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.474133 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.474260 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.474458 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.474584 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.474775 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.474923 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.475082 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.475205 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.475385 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.475515 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.475690 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.475822 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.476011 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.476138 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.476326 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.477056 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.477202 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.477332 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.477493 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.477648 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.477914 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.478041 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.478241 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.478378 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.478553 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.478686 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.478878 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.479013 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.479205 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.479331 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.479511 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.479624 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.479815 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.479938 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.480125 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.480238 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.480489 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.480615 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.480727 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.481125 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.481324 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.481438 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.481628 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.481741 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.481963 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.482091 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.492761 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.493681 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.493681 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.493856 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.494052 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.494141 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.494141 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.494265 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.494337 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.494405 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.494484 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.494551 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.494617 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.494681 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.494747 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.494811 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.494889 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.494982 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.495060 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.495128 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.495202 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.495269 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.495343 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.495411 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.495476 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.495549 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.495641 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.495718 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.495786 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.495851 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.495916 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.495980 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.496046 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.496120 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.496194 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.496275 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.496341 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.496405 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.496470 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.496543 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.496642 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.496719 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.496802 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.496882 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.496958 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.497038 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.497206 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.497293 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.497368 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.497435 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.497509 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.497576 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.497641 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.497706 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.497770 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.497842 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.497916 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.498019 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.498097 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.498165 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.498231 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.498295 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.498373 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.498442 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.498508 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.498574 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.498638 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.498745 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.498825 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.498825 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.498944 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.498944 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.499061 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.499134 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.499207 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.499281 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.499347 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.499432 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.499506 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.499585 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.499652 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.499716 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.499795 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.499874 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.499952 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.500047 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.500125 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.500202 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.500279 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.500357 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.500446 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.500532 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.500611 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.500685 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.500757 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.500845 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.500925 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.501000 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.501073 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.501140 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.501204 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.501270 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.501346 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.501414 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.501479 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.501544 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.501609 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.501673 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.501750 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.501828 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.501895 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.501966 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.502032 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.502096 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.502169 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.502235 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.502300 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.502365 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.502429 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.502501 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.502574 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.502646 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.502713 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.502777 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.502842 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.502928 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.502995 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.503061 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.503125 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.503191 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.503255 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.503329 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.503401 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.503571 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.503664 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.503881 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.503966 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.504205 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.504300 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.504530 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.504624 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.504877 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.504980 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.505196 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.505283 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.505510 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.505597 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.505842 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.505937 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.506166 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.506259 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.506493 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.506578 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.506836 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.506930 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.507157 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.507243 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.507471 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.507555 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.507831 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.507980 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.508811 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.508912 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.508982 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.508982 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.509200 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.509293 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.509373 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.509450 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.509534 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.509738 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.509833 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.510057 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.510147 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.510372 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.510467 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.510690 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.510823 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.511002 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.511096 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.511315 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.511408 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.511629 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.511715 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.511941 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.512027 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.512258 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.512441 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.512565 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.512659 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.512904 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.513028 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.513241 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.513346 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.513567 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.513709 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.513887 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.514025 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.514200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.514289 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.514536 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.514637 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.514837 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.515084 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.515404 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.515562 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.515728 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.515896 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.516049 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.516137 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.516373 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.516468 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.516697 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.516984 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.517118 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.517263 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.517397 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.517522 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.517659 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.517746 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.517944 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.518070 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.518252 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.518339 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.518565 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.518662 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.518869 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.518966 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.519176 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.519339 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.519487 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.519624 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.519785 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.519945 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.520098 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.520187 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.520406 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.520491 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.520724 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.521049 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.521289 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.521388 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.521636 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.521723 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.521956 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.522057 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.522285 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.522424 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.522614 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.522721 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.522927 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.523078 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.523215 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.523358 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.523652 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.524019 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.524147 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.524259 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.524404 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.524502 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.524584 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.524664 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.524757 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.524888 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.525092 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.525180 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.525407 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.525561 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.525717 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.525805 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.526021 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.526167 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.526324 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.526420 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.526628 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.526715 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.526932 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.527055 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.527247 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.527342 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.527554 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.527641 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.527859 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.527954 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.528167 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.528263 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.528469 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.528555 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.528793 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.528883 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.529106 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.529195 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.529411 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.529509 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.529717 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.529811 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.530021 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.530118 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.530325 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.530412 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.530627 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.530714 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.530934 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.531022 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.531236 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.531322 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.531541 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.531629 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.531857 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.531946 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.532208 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.532302 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.532515 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.532616 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.532844 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.532936 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.533151 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.533237 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.533471 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.533577 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.533784 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.533870 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.534093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.534187 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.534406 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.534501 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.534718 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.534813 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.535060 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.535157 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.535380 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.535616 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.535935 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.536022 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.536261 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.536346 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.536584 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.536670 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.536947 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.537035 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.537260 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.537348 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.537570 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.537658 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.537877 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.537964 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.538185 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.538272 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.538509 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.538603 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.538825 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.539516 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.539667 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.539798 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.540012 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.540102 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.540332 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.540441 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.540650 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.540745 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.540994 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.541096 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.541311 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.541406 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.541627 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.541722 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.541942 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.542030 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.542259 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.542346 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.542575 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.542743 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.542889 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.542976 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.543202 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.543286 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.543521 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.543617 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.543856 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.543942 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.544177 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.544264 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.544499 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.544595 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.544838 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.544927 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.545153 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.545239 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.545466 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.545561 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.545775 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.545851 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.546167 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.546306 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.546400 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.546467 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.546702 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.546790 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.547017 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.547112 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.547325 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.547419 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.547630 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.547753 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.548059 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.548155 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.548375 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.548469 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.548695 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.548813 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.549047 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.549134 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.549361 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.549455 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.549686 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.549777 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.550014 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.550118 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.550327 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.550415 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.550636 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.550722 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.550954 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.551041 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.551286 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.551376 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.551612 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.551713 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.551938 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.552026 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.552245 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.552333 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.552550 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.552651 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.552880 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.552999 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.553189 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.553281 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.553507 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.553604 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.553818 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.553904 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.554122 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.554208 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.554425 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.554595 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.555285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.555412 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.555648 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.555745 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.555957 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.556123 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.556269 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.556437 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.556565 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.556901 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.557016 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.557207 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.557335 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.557512 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.557651 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.557816 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.557960 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.558122 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.558271 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.558426 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.558580 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.558729 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.558890 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.559038 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.559201 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.559392 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.559508 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.559648 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.559819 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.559952 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.560127 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.560257 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.560436 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.560560 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.560744 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.560914 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.561077 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.561248 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.561383 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.561565 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.561719 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.561887 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.562056 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.562199 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.562374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.562523 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.562700 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.562836 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.563016 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.563157 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.563340 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.563484 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.563653 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.563803 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.563976 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.564114 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.564312 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.564448 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.564626 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.564794 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.564970 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.565087 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.565310 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.565403 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.565701 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.565787 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.566452 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.566875 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.566972 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.567073 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.576626 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.576817 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.576954 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.577056 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.577139 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.577218 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.577297 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.577376 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.577454 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.577547 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.577667 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.577762 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.577843 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.577929 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.578024 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.578105 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.578183 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.578261 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.578340 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.578425 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.578512 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.578601 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.578681 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.578770 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.578770 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.578915 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.579001 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.579081 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.579163 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.579241 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.579318 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.579405 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.579485 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.579563 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.579647 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.579726 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.579804 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.580004 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.580094 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.580174 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.580261 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.580342 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.580419 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.580506 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.580586 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.580664 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.580749 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.580847 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.580927 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.581019 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.581101 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.581179 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.581257 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.581335 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.581422 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.581510 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.581597 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.581666 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.581737 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.581810 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.581884 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.581957 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.582023 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.582100 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:36:43.582178 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.582178 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:36:43.582178 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:36:43.638892 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO dbcounter [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] Registered counter for database nova_api Jul 18 10:36:43.639671 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO dbcounter [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] Registered counter for database nova_api Jul 18 10:36:43.753918 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_db.sqlalchemy.engines [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110404) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:36:43.756207 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG oslo_db.sqlalchemy.engines [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:36:43.761991 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG dbcounter [-] [110404] Writer thread running {{(pid=110404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:36:43.762978 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG dbcounter [-] [110405] Writer thread running {{(pid=110405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:36:43.819687 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.context [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d33ec79-71c2-4367-aeee-4165661be946(cell1) {{(pid=110404) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 10:36:43.821178 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.context [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d33ec79-71c2-4367-aeee-4165661be946(cell1) {{(pid=110405) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 10:36:43.823827 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:43.825086 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG oslo_concurrency.lockutils [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:43.825461 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:43.826262 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:43.826683 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG oslo_concurrency.lockutils [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:43.827494 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG oslo_concurrency.lockutils [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:43.828434 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:43.829682 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG oslo_concurrency.lockutils [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:43.830474 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO dbcounter [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] Registered counter for database nova_cell0 Jul 18 10:36:43.831671 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO dbcounter [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] Registered counter for database nova_cell0 Jul 18 10:36:43.834397 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO dbcounter [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] Registered counter for database nova_cell1 Jul 18 10:36:43.835688 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO dbcounter [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] Registered counter for database nova_cell1 Jul 18 10:36:43.843757 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_db.sqlalchemy.engines [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110404) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:36:43.845843 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_db.sqlalchemy.engines [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110404) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:36:43.847296 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG oslo_db.sqlalchemy.engines [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:36:43.848768 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG oslo_db.sqlalchemy.engines [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:36:43.853694 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG dbcounter [-] [110404] Writer thread running {{(pid=110404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:36:43.854983 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG dbcounter [-] [110404] Writer thread running {{(pid=110404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:36:43.856277 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG dbcounter [-] [110405] Writer thread running {{(pid=110405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:36:43.857586 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG dbcounter [-] [110405] Writer thread running {{(pid=110405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:36:44.002786 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO dbcounter [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] Registered counter for database nova_cell0 Jul 18 10:36:44.006296 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO dbcounter [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] Registered counter for database nova_cell0 Jul 18 10:36:44.009811 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_db.sqlalchemy.engines [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110404) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:36:44.014839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG dbcounter [-] [110404] Writer thread running {{(pid=110404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:36:44.016084 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG oslo_db.sqlalchemy.engines [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:36:44.020590 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG dbcounter [-] [110405] Writer thread running {{(pid=110405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:36:44.455747 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: WARNING keystonemiddleware.auth_token [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:36:44.463353 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: WARNING keystonemiddleware.auth_token [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:36:44.508750 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: WARNING keystonemiddleware.auth_token [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:36:44.516273 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: WARNING keystonemiddleware.auth_token [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:36:44.813576 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: WARNING keystonemiddleware.auth_token [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:36:44.819744 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: WARNING keystonemiddleware.auth_token [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:36:44.826406 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d5b340a9c0 pid: 110404 (default app) Jul 18 10:36:44.828689 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:44.829953 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001932 Jul 18 10:36:44.830338 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Mon Jul 18 10:36:44 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:44.860131 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: WARNING keystonemiddleware.auth_token [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:36:44.866137 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: WARNING keystonemiddleware.auth_token [None req-0b58d932-5302-4c67-a2d4-dd633149496e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:36:44.871458 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d5b340a9c0 pid: 110405 (default app) Jul 18 10:38:06.656621 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:06.657665 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 18 10:38:06.658225 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 18 10:38:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:38:06.672852 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG dbcounter [-] [110405] Writing DB stats nova_api:SELECT=3 {{(pid=110405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:06.674028 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG dbcounter [-] [110405] Writing DB stats nova_cell0:SELECT=3 {{(pid=110405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:06.675222 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG dbcounter [-] [110405] Writing DB stats nova_cell1:SELECT=3 {{(pid=110405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:06.676161 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG dbcounter [-] [110405] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:07.684850 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-62c593d0-a928-4e12-a1ba-382b821173d5 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:07.718610 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-62c593d0-a928-4e12-a1ba-382b821173d5 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.052181 Jul 18 10:38:07.720994 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Jul 18 10:38:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:38:10.050933 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:10.052540 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-fce090cf-c500-4c92-bf42-df95ea6b5207 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001940 Jul 18 10:38:10.057180 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 18 10:38:10 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:38:10.594387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-3c9a00bb-e56e-4776-a664-3edfebb8dfb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "id": "c1"}} {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:10.614362 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:38:10.614362 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: warnings.warn(msg) Jul 18 10:38:10.720863 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-3c9a00bb-e56e-4776-a664-3edfebb8dfb7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.661049 Jul 18 10:38:10.730126 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 18 10:38:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:38:10.738671 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG dbcounter [-] [110404] Writing DB stats nova_api:SELECT=3 {{(pid=110404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:10.740341 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG dbcounter [-] [110404] Writing DB stats nova_cell0:SELECT=3 {{(pid=110404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:10.741255 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG dbcounter [-] [110404] Writing DB stats nova_cell1:SELECT=3 {{(pid=110404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:10.742137 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG dbcounter [-] [110404] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:10.965919 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-c70b7f3d-c144-4d0b-b507-e57c75181afa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:10.968756 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:38:10.968756 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: warnings.warn(msg) Jul 18 10:38:11.153938 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-c70b7f3d-c144-4d0b-b507-e57c75181afa admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.421308 Jul 18 10:38:11.154598 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Jul 18 10:38:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:38:13.482954 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-3c9a00bb-e56e-4776-a664-3edfebb8dfb7 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:13.483972 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-3c9a00bb-e56e-4776-a664-3edfebb8dfb7 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 18 10:38:13.484364 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 18 10:38:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:38:14.205973 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-943e96b0-27b4-4784-b231-503a47a9319c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "rxtx_factor": 1.0, "id": "d1", "ram": 512, "swap": 0, "disk": 5, "vcpus": 1}} {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:14.225536 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:38:14.225536 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: warnings.warn(msg) Jul 18 10:38:14.360286 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-943e96b0-27b4-4784-b231-503a47a9319c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.868820 Jul 18 10:38:14.361141 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 18 10:38:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 10:38:14.374517 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-3d25f5f8-5c1b-45ce-854a-b8052d3d1277 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:14.376068 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:38:14.376068 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: warnings.warn(msg) Jul 18 10:38:14.503860 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-3d25f5f8-5c1b-45ce-854a-b8052d3d1277 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.133457 Jul 18 10:38:14.512408 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Jul 18 10:38:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:38:16.772077 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-943e96b0-27b4-4784-b231-503a47a9319c admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:16.773330 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-943e96b0-27b4-4784-b231-503a47a9319c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001707 Jul 18 10:38:16.774006 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 18 10:38:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:38:17.212409 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-c011bebe-dbd0-4ee7-ae93-aa482c4534d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 10, "id": "d2", "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:17.295197 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-c011bebe-dbd0-4ee7-ae93-aa482c4534d0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.515058 Jul 18 10:38:17.296076 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 18 10:38:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 10:38:17.307987 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-1a4ba9f0-c88d-4fd1-93e7-7b14a8c8311e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:17.412466 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-1a4ba9f0-c88d-4fd1-93e7-7b14a8c8311e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107963 Jul 18 10:38:17.413360 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Jul 18 10:38:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:38:19.712656 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-c011bebe-dbd0-4ee7-ae93-aa482c4534d0 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:19.713994 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-c011bebe-dbd0-4ee7-ae93-aa482c4534d0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001900 Jul 18 10:38:19.714400 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 18 10:38:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:38:20.197449 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-73c5a48b-32f3-4782-b153-708804655b3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:20.289688 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-73c5a48b-32f3-4782-b153-708804655b3e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.568507 Jul 18 10:38:20.290267 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 18 10:38:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:38:20.303030 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-acfe7060-f1c4-4c43-8082-004bc246dda2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:20.401492 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-acfe7060-f1c4-4c43-8082-004bc246dda2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102859 Jul 18 10:38:20.402385 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Jul 18 10:38:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:38:22.757414 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-73c5a48b-32f3-4782-b153-708804655b3e admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:22.759617 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-73c5a48b-32f3-4782-b153-708804655b3e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002253 Jul 18 10:38:22.759617 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 18 10:38:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:38:23.272615 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-0b8209b5-7016-4fde-bfdf-5fb4e82dc9c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:23.376879 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-0b8209b5-7016-4fde-bfdf-5fb4e82dc9c6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.611195 Jul 18 10:38:23.385815 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 18 10:38:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:38:23.393828 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-c103bc9b-203b-4698-a234-a0e5bafdec2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:23.477810 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-c103bc9b-203b-4698-a234-a0e5bafdec2c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090077 Jul 18 10:38:23.478624 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Jul 18 10:38:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:38:26.115638 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-0b8209b5-7016-4fde-bfdf-5fb4e82dc9c6 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:26.116683 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-0b8209b5-7016-4fde-bfdf-5fb4e82dc9c6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 18 10:38:26.117149 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 18 10:38:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:38:26.596523 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-bf8af161-faa5-449b-9a68-e1e4e4a7c929 admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:26.622285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-bf8af161-faa5-449b-9a68-e1e4e4a7c929 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.498851 Jul 18 10:38:26.622843 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Jul 18 10:38:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:28.914725 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-0b8209b5-7016-4fde-bfdf-5fb4e82dc9c6 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:28.915681 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-0b8209b5-7016-4fde-bfdf-5fb4e82dc9c6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 18 10:38:28.916347 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 18 10:38:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:38:29.401666 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-0935386e-d93e-4ed2-8ef3-92d483053832 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "swap": 0}} {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:29.546331 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-0935386e-d93e-4ed2-8ef3-92d483053832 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.623863 Jul 18 10:38:29.546993 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 18 10:38:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:38:29.559672 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-c2f5dbfa-5cb8-4d52-a109-8bf561371d8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:29.653256 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-c2f5dbfa-5cb8-4d52-a109-8bf561371d8c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097206 Jul 18 10:38:29.653876 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Jul 18 10:38:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:38:31.911909 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-0935386e-d93e-4ed2-8ef3-92d483053832 admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:31.913808 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-0935386e-d93e-4ed2-8ef3-92d483053832 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002814 Jul 18 10:38:31.914295 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 18 10:38:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:38:32.328625 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-4983b876-2ec0-44d8-ad7a-3c580a8ced69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20}} {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:32.470972 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-4983b876-2ec0-44d8-ad7a-3c580a8ced69 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.550503 Jul 18 10:38:32.471849 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 18 10:38:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 10:38:32.484271 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-b3c4ab1c-6eef-4167-8df4-5e1b498c5e41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:32.754994 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-b3c4ab1c-6eef-4167-8df4-5e1b498c5e41 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.274188 Jul 18 10:38:32.755624 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Jul 18 10:38:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:38:35.022244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-4983b876-2ec0-44d8-ad7a-3c580a8ced69 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:35.023268 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-4983b876-2ec0-44d8-ad7a-3c580a8ced69 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 18 10:38:35.023672 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 18 10:38:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:38:35.391800 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-1f2d59ad-094a-4a59-81f7-9cf9e7157351 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "name": "m1.medium", "id": "3", "ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:35.496592 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-1f2d59ad-094a-4a59-81f7-9cf9e7157351 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.466698 Jul 18 10:38:35.497622 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 18 10:38:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:38:35.510622 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-91eb2748-3a05-4513-9345-f404039ff738 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:35.623966 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-91eb2748-3a05-4513-9345-f404039ff738 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117454 Jul 18 10:38:35.624504 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Jul 18 10:38:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:38:37.908266 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-1f2d59ad-094a-4a59-81f7-9cf9e7157351 admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:37.909316 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-1f2d59ad-094a-4a59-81f7-9cf9e7157351 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 18 10:38:37.909717 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 18 10:38:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:38:38.401242 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-899ce0df-3885-400d-a98e-edcb7f0b553e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "id": "4", "ram": 8192, "swap": 0}} {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:38.406902 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG dbcounter [-] [110405] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:38.609349 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-899ce0df-3885-400d-a98e-edcb7f0b553e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.689418 Jul 18 10:38:38.668794 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 18 10:38:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:38:38.669033 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-5c9b0e43-5858-4fce-80a5-84f190059dbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:39.636951 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-5c9b0e43-5858-4fce-80a5-84f190059dbc admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 1.015331 Jul 18 10:38:39.649499 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Jul 18 10:38:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:38:42.141524 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-899ce0df-3885-400d-a98e-edcb7f0b553e admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:42.142575 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-899ce0df-3885-400d-a98e-edcb7f0b553e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 18 10:38:42.142969 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 18 10:38:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:38:42.633050 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-c06a8809-689b-4be4-8613-d48c0a8125af admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:42.639614 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG dbcounter [-] [110404] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=110404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:42.751844 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-c06a8809-689b-4be4-8613-d48c0a8125af admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.602025 Jul 18 10:38:42.752353 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 18 10:38:42 2022] POST /compute/v2.1/flavors => generated 408 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:38:42.765016 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-cb184d28-950c-483b-a301-f66e5c7ffd1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:42.864355 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-cb184d28-950c-483b-a301-f66e5c7ffd1e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103034 Jul 18 10:38:42.865004 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Jul 18 10:38:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:39:02.857817 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-c06a8809-689b-4be4-8613-d48c0a8125af admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:02.858820 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-c06a8809-689b-4be4-8613-d48c0a8125af admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 18 10:39:02.859222 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 18 10:39:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:39:03.267260 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-56ea5f8a-0595-4bd4-b4a6-88c862497ac8 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:03.286039 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-56ea5f8a-0595-4bd4-b4a6-88c862497ac8 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.419971 Jul 18 10:39:03.286480 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Jul 18 10:39:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:39:04.383103 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-c06a8809-689b-4be4-8613-d48c0a8125af admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:04.384121 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-c06a8809-689b-4be4-8613-d48c0a8125af admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jul 18 10:39:04.384518 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 18 10:39:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:39:04.954931 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-6f55645b-4a3e-42a0-97ae-df3dbfa29a74 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:04.962875 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.wsgi [None req-6f55645b-4a3e-42a0-97ae-df3dbfa29a74 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-6f55645b-4a3e-42a0-97ae-df3dbfa29a74 admin admin] Request method failure captured: Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Accept: application/json Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Accept-Encoding: gzip, deflate Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Connection: keep-alive Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Content-Length: 0 Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Host: 10.222.0.49 Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Openstack-Api-Version: compute 2.90 Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Openstack-System-Scope: None Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: User-Agent: python-novaclient Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Auth-Token: gAAAAABi1ThIRVoCWWd-HO2A51W9qTnYNTdgYRobeaKRvIildjBGl08L2_BR2OcUHjt6VAA2uCtKScgX1D9gqgW3q-grYFUlDC8rUA-0DC8XhRQ1odxHLRtw8hnNmEeXpLhF9OS6e91WrOC8gm4lJnkInAvfXH5m4br_loLtFI21MJ6kFW8LQyE Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Domain-Id: None Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Domain-Name: None Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Identity-Status: Confirmed Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Is-Admin-Project: True Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Project-Domain-Id: default Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Project-Domain-Name: Default Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Project-Id: 233b60ec452b417c902a9645e05969db Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Project-Name: admin Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Role: reader,admin,member Jul 18 10:39:04.967370 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Roles: reader,admin,member Jul 18 10:39:04.969530 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/233b60ec452b417c902a9645e05969db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_233b60ec452b417c902a9645e05969db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/233b60ec452b417c902a9645e05969db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/233b60ec452b417c902a9645e05969db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:39:04.969530 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Tenant: admin Jul 18 10:39:04.969530 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Tenant-Id: 233b60ec452b417c902a9645e05969db Jul 18 10:39:04.969530 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Tenant-Name: admin Jul 18 10:39:04.969530 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-User: admin Jul 18 10:39:04.969530 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-User-Domain-Id: default Jul 18 10:39:04.969530 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-User-Domain-Name: Default Jul 18 10:39:04.969530 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-User-Id: bf6162d0fbf040d78eb20f2b6ea7ba47 Jul 18 10:39:04.969530 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-User-Name: admin Jul 18 10:39:04.969530 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: method: > Jul 18 10:39:04.969530 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: exception: Flavor 42 could not be found. Jul 18 10:39:04.969530 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: action_args: {'id': '42'} Jul 18 10:39:04.969530 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:04.969530 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:04.970496 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Jul 18 10:39:04.972593 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-6f55645b-4a3e-42a0-97ae-df3dbfa29a74 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:04.974393 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-6f55645b-4a3e-42a0-97ae-df3dbfa29a74 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.440365 Jul 18 10:39:04.974393 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 18 10:39:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:39:04.983713 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-eaa10a4c-0961-414e-87d4-e8833219c6df admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:05.016814 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-eaa10a4c-0961-414e-87d4-e8833219c6df admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.040184 Jul 18 10:39:05.017420 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 18 10:39:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:39:05.028647 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-2bed79b2-fb13-4ea0-ba0d-49d96ac87dd3 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:05.051145 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-2bed79b2-fb13-4ea0-ba0d-49d96ac87dd3 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026116 Jul 18 10:39:05.051717 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 18 10:39:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:39:05.062212 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-b7e94da5-4be3-48cb-bd4c-037cf0521d16 admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:05.069608 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.wsgi [None req-b7e94da5-4be3-48cb-bd4c-037cf0521d16 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-b7e94da5-4be3-48cb-bd4c-037cf0521d16 admin admin] Request method failure captured: Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Accept: application/json Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Accept-Encoding: gzip, deflate Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Connection: keep-alive Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Content-Length: 0 Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Host: 10.222.0.49 Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Openstack-Api-Version: compute 2.90 Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Openstack-System-Scope: None Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: User-Agent: python-novaclient Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Auth-Token: gAAAAABi1ThIRVoCWWd-HO2A51W9qTnYNTdgYRobeaKRvIildjBGl08L2_BR2OcUHjt6VAA2uCtKScgX1D9gqgW3q-grYFUlDC8rUA-0DC8XhRQ1odxHLRtw8hnNmEeXpLhF9OS6e91WrOC8gm4lJnkInAvfXH5m4br_loLtFI21MJ6kFW8LQyE Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Domain-Id: None Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Domain-Name: None Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Identity-Status: Confirmed Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Is-Admin-Project: True Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Project-Domain-Id: default Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Project-Domain-Name: Default Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Project-Id: 233b60ec452b417c902a9645e05969db Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Project-Name: admin Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Role: reader,admin,member Jul 18 10:39:05.073093 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Roles: reader,admin,member Jul 18 10:39:05.078013 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/233b60ec452b417c902a9645e05969db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_233b60ec452b417c902a9645e05969db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/233b60ec452b417c902a9645e05969db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/233b60ec452b417c902a9645e05969db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:39:05.078013 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Tenant: admin Jul 18 10:39:05.078013 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Tenant-Id: 233b60ec452b417c902a9645e05969db Jul 18 10:39:05.078013 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Tenant-Name: admin Jul 18 10:39:05.078013 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-User: admin Jul 18 10:39:05.078013 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-User-Domain-Id: default Jul 18 10:39:05.078013 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-User-Domain-Name: Default Jul 18 10:39:05.078013 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-User-Id: bf6162d0fbf040d78eb20f2b6ea7ba47 Jul 18 10:39:05.078013 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-User-Name: admin Jul 18 10:39:05.078013 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: method: > Jul 18 10:39:05.078013 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: exception: Flavor 42 could not be found. Jul 18 10:39:05.078013 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: action_args: {'id': '42'} Jul 18 10:39:05.078013 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:05.078013 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:05.078999 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Jul 18 10:39:05.080200 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-b7e94da5-4be3-48cb-bd4c-037cf0521d16 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:05.083182 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-b7e94da5-4be3-48cb-bd4c-037cf0521d16 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016594 Jul 18 10:39:05.083182 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 18 10:39:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 18 10:39:06.070465 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-2bed79b2-fb13-4ea0-ba0d-49d96ac87dd3 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:06.071522 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-2bed79b2-fb13-4ea0-ba0d-49d96ac87dd3 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jul 18 10:39:06.072065 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 18 10:39:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:39:06.637817 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-8c1e223f-5939-43f6-9c30-83d3e7a37f17 admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:06.643287 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.wsgi [None req-8c1e223f-5939-43f6-9c30-83d3e7a37f17 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-8c1e223f-5939-43f6-9c30-83d3e7a37f17 admin admin] Request method failure captured: Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Accept: application/json Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Accept-Encoding: gzip, deflate Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Connection: keep-alive Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Content-Length: 0 Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Host: 10.222.0.49 Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Openstack-Api-Version: compute 2.90 Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Openstack-System-Scope: None Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: User-Agent: python-novaclient Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Auth-Token: gAAAAABi1ThJjlz2XA3c1eH5etZfFR77wMBQMD1jyZC0xwwO6WczycNSgFtFNPrkWbvct8nRMyw41vv_Z0aX3qnMSytl14sw40IYG6-rf4i_qijE75Y-VoT9v0CH7j7tTDtShgwkjsxuPNMWD-LpXmXNO1eyDFdbhwtpSees6rQ5jAa0Ulhr2gM Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Domain-Id: None Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Domain-Name: None Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Identity-Status: Confirmed Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Is-Admin-Project: True Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Project-Domain-Id: default Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Project-Domain-Name: Default Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Project-Id: 233b60ec452b417c902a9645e05969db Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Project-Name: admin Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Role: reader,admin,member Jul 18 10:39:06.644839 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Roles: reader,admin,member Jul 18 10:39:06.646324 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/233b60ec452b417c902a9645e05969db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_233b60ec452b417c902a9645e05969db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/233b60ec452b417c902a9645e05969db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/233b60ec452b417c902a9645e05969db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:39:06.646324 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Tenant: admin Jul 18 10:39:06.646324 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Tenant-Id: 233b60ec452b417c902a9645e05969db Jul 18 10:39:06.646324 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Tenant-Name: admin Jul 18 10:39:06.646324 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-User: admin Jul 18 10:39:06.646324 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-User-Domain-Id: default Jul 18 10:39:06.646324 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-User-Domain-Name: Default Jul 18 10:39:06.646324 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-User-Id: bf6162d0fbf040d78eb20f2b6ea7ba47 Jul 18 10:39:06.646324 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-User-Name: admin Jul 18 10:39:06.646324 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: method: > Jul 18 10:39:06.646324 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: exception: Flavor 84 could not be found. Jul 18 10:39:06.646324 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: action_args: {'id': '84'} Jul 18 10:39:06.646324 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:06.646324 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:06.648285 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Jul 18 10:39:06.649649 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-8c1e223f-5939-43f6-9c30-83d3e7a37f17 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:06.650923 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-8c1e223f-5939-43f6-9c30-83d3e7a37f17 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.432709 Jul 18 10:39:06.650923 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 18 10:39:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:39:06.656160 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-42ad3cd0-026a-4454-ba5f-bf3fdc8b0434 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:06.671328 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-42ad3cd0-026a-4454-ba5f-bf3fdc8b0434 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018740 Jul 18 10:39:06.671900 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 18 10:39:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:39:06.682988 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-101421e5-2f91-4bd0-948a-4b65821397a2 admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:06.697404 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-101421e5-2f91-4bd0-948a-4b65821397a2 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017937 Jul 18 10:39:06.697968 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 18 10:39:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:39:06.707573 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-9f2ce5c5-2784-4497-ad81-54ba1a6240b5 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:06.713251 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.wsgi [None req-9f2ce5c5-2784-4497-ad81-54ba1a6240b5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-9f2ce5c5-2784-4497-ad81-54ba1a6240b5 admin admin] Request method failure captured: Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Accept: application/json Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Accept-Encoding: gzip, deflate Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Connection: keep-alive Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Content-Length: 0 Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Host: 10.222.0.49 Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Openstack-Api-Version: compute 2.90 Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Openstack-System-Scope: None Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: User-Agent: python-novaclient Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Auth-Token: gAAAAABi1ThJjlz2XA3c1eH5etZfFR77wMBQMD1jyZC0xwwO6WczycNSgFtFNPrkWbvct8nRMyw41vv_Z0aX3qnMSytl14sw40IYG6-rf4i_qijE75Y-VoT9v0CH7j7tTDtShgwkjsxuPNMWD-LpXmXNO1eyDFdbhwtpSees6rQ5jAa0Ulhr2gM Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Domain-Id: None Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Domain-Name: None Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Identity-Status: Confirmed Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Is-Admin-Project: True Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Project-Domain-Id: default Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Project-Domain-Name: Default Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Project-Id: 233b60ec452b417c902a9645e05969db Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Project-Name: admin Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Role: reader,admin,member Jul 18 10:39:06.714802 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Roles: reader,admin,member Jul 18 10:39:06.716387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/233b60ec452b417c902a9645e05969db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_233b60ec452b417c902a9645e05969db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/233b60ec452b417c902a9645e05969db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/233b60ec452b417c902a9645e05969db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:39:06.716387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Tenant: admin Jul 18 10:39:06.716387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Tenant-Id: 233b60ec452b417c902a9645e05969db Jul 18 10:39:06.716387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Tenant-Name: admin Jul 18 10:39:06.716387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-User: admin Jul 18 10:39:06.716387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-User-Domain-Id: default Jul 18 10:39:06.716387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-User-Domain-Name: Default Jul 18 10:39:06.716387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-User-Id: bf6162d0fbf040d78eb20f2b6ea7ba47 Jul 18 10:39:06.716387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-User-Name: admin Jul 18 10:39:06.716387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: method: > Jul 18 10:39:06.716387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: exception: Flavor 84 could not be found. Jul 18 10:39:06.716387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: action_args: {'id': '84'} Jul 18 10:39:06.716387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:06.716387 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:06.717374 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Jul 18 10:39:06.718780 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-9f2ce5c5-2784-4497-ad81-54ba1a6240b5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:06.720079 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-9f2ce5c5-2784-4497-ad81-54ba1a6240b5 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012296 Jul 18 10:39:06.720079 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 18 10:39:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:39:07.730849 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-101421e5-2f91-4bd0-948a-4b65821397a2 admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:07.732120 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-101421e5-2f91-4bd0-948a-4b65821397a2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002151 Jul 18 10:39:07.732834 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 18 10:39:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:39:08.301522 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-26cc567a-530b-4914-9efb-16f777ba5972 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:08.307596 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.wsgi [None req-26cc567a-530b-4914-9efb-16f777ba5972 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-26cc567a-530b-4914-9efb-16f777ba5972 admin admin] Request method failure captured: Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Accept: application/json Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Accept-Encoding: gzip, deflate Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Connection: keep-alive Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Content-Length: 0 Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Host: 10.222.0.49 Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Openstack-Api-Version: compute 2.90 Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Openstack-System-Scope: None Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: User-Agent: python-novaclient Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Auth-Token: gAAAAABi1ThLL1BBMLUB8M5mCC45Qj_VhGzbUqo29HRLaiy8RWNTX3V3Xhaey9hD_6jp1FcM274S17WRYbxxqaSP86kHaDYxCLBnddzkYRRzJ1FOajJ0sy4Awa1Mxzxea4e4-ir4Ody_emMI1Y6MoRuEX7JXblG-fc0jv3JA8UuJw-GO0bBICpU Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Domain-Id: None Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Domain-Name: None Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Identity-Status: Confirmed Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Is-Admin-Project: True Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Project-Domain-Id: default Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Project-Domain-Name: Default Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Project-Id: 233b60ec452b417c902a9645e05969db Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Project-Name: admin Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Role: reader,admin,member Jul 18 10:39:08.309136 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Roles: reader,admin,member Jul 18 10:39:08.310950 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/233b60ec452b417c902a9645e05969db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_233b60ec452b417c902a9645e05969db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/233b60ec452b417c902a9645e05969db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/233b60ec452b417c902a9645e05969db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:39:08.310950 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Tenant: admin Jul 18 10:39:08.310950 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Tenant-Id: 233b60ec452b417c902a9645e05969db Jul 18 10:39:08.310950 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-Tenant-Name: admin Jul 18 10:39:08.310950 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-User: admin Jul 18 10:39:08.310950 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-User-Domain-Id: default Jul 18 10:39:08.310950 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-User-Domain-Name: Default Jul 18 10:39:08.310950 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-User-Id: bf6162d0fbf040d78eb20f2b6ea7ba47 Jul 18 10:39:08.310950 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: X-User-Name: admin Jul 18 10:39:08.310950 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: method: > Jul 18 10:39:08.310950 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: exception: Flavor 451 could not be found. Jul 18 10:39:08.310950 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: action_args: {'id': '451'} Jul 18 10:39:08.310950 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:08.310950 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:08.311949 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: ERROR nova.api.openstack.wsgi Jul 18 10:39:08.313244 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-26cc567a-530b-4914-9efb-16f777ba5972 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:08.314492 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-26cc567a-530b-4914-9efb-16f777ba5972 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.439215 Jul 18 10:39:08.314492 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 18 10:39:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:39:08.324808 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-f2d02471-0633-419b-a456-00413dd674d7 admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:08.340263 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-f2d02471-0633-419b-a456-00413dd674d7 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022133 Jul 18 10:39:08.340856 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 18 10:39:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:39:08.351504 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-326af328-dad3-4e7e-b82c-ebba557f4293 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:08.368602 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-326af328-dad3-4e7e-b82c-ebba557f4293 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020761 Jul 18 10:39:08.369275 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 18 10:39:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:39:08.381122 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-bf9656dd-b8dd-4adf-9383-e246b801acdd admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:08.387984 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.wsgi [None req-bf9656dd-b8dd-4adf-9383-e246b801acdd admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-bf9656dd-b8dd-4adf-9383-e246b801acdd admin admin] Request method failure captured: Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Accept: application/json Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Accept-Encoding: gzip, deflate Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Connection: keep-alive Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Content-Length: 0 Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Host: 10.222.0.49 Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Openstack-Api-Version: compute 2.90 Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Openstack-System-Scope: None Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: User-Agent: python-novaclient Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Auth-Token: gAAAAABi1ThLL1BBMLUB8M5mCC45Qj_VhGzbUqo29HRLaiy8RWNTX3V3Xhaey9hD_6jp1FcM274S17WRYbxxqaSP86kHaDYxCLBnddzkYRRzJ1FOajJ0sy4Awa1Mxzxea4e4-ir4Ody_emMI1Y6MoRuEX7JXblG-fc0jv3JA8UuJw-GO0bBICpU Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Domain-Id: None Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Domain-Name: None Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Identity-Status: Confirmed Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Is-Admin-Project: True Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Project-Domain-Id: default Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Project-Domain-Name: Default Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Project-Id: 233b60ec452b417c902a9645e05969db Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Project-Name: admin Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Role: reader,admin,member Jul 18 10:39:08.389851 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Roles: reader,admin,member Jul 18 10:39:08.397521 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/233b60ec452b417c902a9645e05969db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_233b60ec452b417c902a9645e05969db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/233b60ec452b417c902a9645e05969db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/233b60ec452b417c902a9645e05969db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:39:08.397521 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Tenant: admin Jul 18 10:39:08.397521 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Tenant-Id: 233b60ec452b417c902a9645e05969db Jul 18 10:39:08.397521 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-Tenant-Name: admin Jul 18 10:39:08.397521 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-User: admin Jul 18 10:39:08.397521 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-User-Domain-Id: default Jul 18 10:39:08.397521 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-User-Domain-Name: Default Jul 18 10:39:08.397521 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-User-Id: bf6162d0fbf040d78eb20f2b6ea7ba47 Jul 18 10:39:08.397521 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: X-User-Name: admin Jul 18 10:39:08.397521 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: method: > Jul 18 10:39:08.397521 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: exception: Flavor 451 could not be found. Jul 18 10:39:08.397521 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: action_args: {'id': '451'} Jul 18 10:39:08.397521 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:08.397521 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:08.399064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: ERROR nova.api.openstack.wsgi Jul 18 10:39:08.401229 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-bf9656dd-b8dd-4adf-9383-e246b801acdd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:08.403272 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-bf9656dd-b8dd-4adf-9383-e246b801acdd admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015883 Jul 18 10:39:08.403272 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 18 10:39:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:39:09.508600 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-326af328-dad3-4e7e-b82c-ebba557f4293 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:09.509914 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-326af328-dad3-4e7e-b82c-ebba557f4293 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001750 Jul 18 10:39:09.510418 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 18 10:39:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:39:10.234222 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-5b26eabd-8d2f-4eea-8100-3de6c97391fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:39:10.333741 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-5b26eabd-8d2f-4eea-8100-3de6c97391fa admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.672505 Jul 18 10:39:10.335077 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Jul 18 10:39:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:39:11.486323 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-326af328-dad3-4e7e-b82c-ebba557f4293 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:11.488630 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-326af328-dad3-4e7e-b82c-ebba557f4293 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003067 Jul 18 10:39:11.489461 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 18 10:39:11 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:39:12.167111 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-9cc79384-a1de-4d8d-9be9-dd07f0374970 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:39:12.243929 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-9cc79384-a1de-4d8d-9be9-dd07f0374970 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.546054 Jul 18 10:39:12.244494 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Jul 18 10:39:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:39:13.285811 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-326af328-dad3-4e7e-b82c-ebba557f4293 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:13.286887 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-326af328-dad3-4e7e-b82c-ebba557f4293 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 18 10:39:13.287286 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 18 10:39:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:39:13.880257 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-0bc72852-58c6-41ab-aea2-b520021c88da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:39:13.968282 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-0bc72852-58c6-41ab-aea2-b520021c88da admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.538906 Jul 18 10:39:13.968741 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Jul 18 10:39:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:39:15.018850 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-326af328-dad3-4e7e-b82c-ebba557f4293 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:15.020201 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-326af328-dad3-4e7e-b82c-ebba557f4293 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002108 Jul 18 10:39:15.020703 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 18 10:39:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:39:15.579950 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-a7efd51f-a2f1-410b-af97-66a3d8314033 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:39:15.684915 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-a7efd51f-a2f1-410b-af97-66a3d8314033 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.520092 Jul 18 10:39:15.685682 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Jul 18 10:39:15 2022] POST /compute/v2.1/flavors => generated 409 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:39:16.722942 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-326af328-dad3-4e7e-b82c-ebba557f4293 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:16.723980 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-326af328-dad3-4e7e-b82c-ebba557f4293 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 18 10:39:16.724422 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 18 10:39:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:39:17.296099 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-e2d2ef4d-4eb5-4e99-8758-76cef58dcc9d admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:17.317975 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-e2d2ef4d-4eb5-4e99-8758-76cef58dcc9d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.451876 Jul 18 10:39:17.318458 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Mon Jul 18 10:39:16 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:40:13.780652 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-326af328-dad3-4e7e-b82c-ebba557f4293 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:40:13.782279 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-326af328-dad3-4e7e-b82c-ebba557f4293 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 18 10:40:13.782744 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 18 10:40:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:40:13.794303 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG dbcounter [-] [110404] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=110404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:14.191035 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-215bd87f-6264-4874-a3ff-1c03b6b2ff31 admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:40:14.210642 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-215bd87f-6264-4874-a3ff-1c03b6b2ff31 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.421160 Jul 18 10:40:14.211184 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Jul 18 10:40:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:40:14.232049 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG dbcounter [-] [110405] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:14.236398 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-c31b8fb6-9887-4596-b1da-e00152dab6e7 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:40:14.243976 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-c31b8fb6-9887-4596-b1da-e00152dab6e7 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013516 Jul 18 10:40:14.244503 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1282 bytes} [Mon Jul 18 10:40:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:40:14.257293 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-6cd78195-412c-4581-ae4d-211e08130e0b admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:40:14.265018 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-6cd78195-412c-4581-ae4d-211e08130e0b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011369 Jul 18 10:40:14.265541 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1285 bytes} [Mon Jul 18 10:40:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:40:14.277445 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-1f460e55-a030-4256-a21f-91297e416c30 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:40:14.286586 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-1f460e55-a030-4256-a21f-91297e416c30 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012681 Jul 18 10:40:14.287054 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1285 bytes} [Mon Jul 18 10:40:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:40:14.299636 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-ee05530b-6623-40cf-8201-8a57ff4ef418 admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:40:14.307636 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-ee05530b-6623-40cf-8201-8a57ff4ef418 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012472 Jul 18 10:40:14.308170 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1282 bytes} [Mon Jul 18 10:40:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:48.942191 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-1f460e55-a030-4256-a21f-91297e416c30 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:48.944606 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-1f460e55-a030-4256-a21f-91297e416c30 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002486 Jul 18 10:44:48.945445 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 18 10:44:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:49.127800 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG dbcounter [-] [110404] Writing DB stats nova_api:SELECT=6 {{(pid=110404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:49.346101 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-f86b01ef-c7df-45e1-92b5-728852f30b97 admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:49.348634 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:44:49.348634 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: warnings.warn(msg) Jul 18 10:44:49.353007 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-f86b01ef-c7df-45e1-92b5-728852f30b97 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:49.353975 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-f86b01ef-c7df-45e1-92b5-728852f30b97 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:49.355883 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-f86b01ef-c7df-45e1-92b5-728852f30b97 admin admin] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:49.356735 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-f86b01ef-c7df-45e1-92b5-728852f30b97 admin admin] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:49.437949 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-f86b01ef-c7df-45e1-92b5-728852f30b97 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.311875 Jul 18 10:44:49.438991 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 18 10:44:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 10:44:50.527294 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-1f460e55-a030-4256-a21f-91297e416c30 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:50.529223 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-1f460e55-a030-4256-a21f-91297e416c30 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002345 Jul 18 10:44:50.530016 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 18 10:44:50 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:44:50.754522 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-a669e3d9-8143-42e1-8fa4-63c00a1c214f admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:50.755798 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:44:50.755798 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: warnings.warn(msg) Jul 18 10:44:50.757180 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-a669e3d9-8143-42e1-8fa4-63c00a1c214f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:50.758178 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-a669e3d9-8143-42e1-8fa4-63c00a1c214f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:50.759064 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-a669e3d9-8143-42e1-8fa4-63c00a1c214f admin admin] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:50.759514 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-a669e3d9-8143-42e1-8fa4-63c00a1c214f admin admin] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:50.782143 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-a669e3d9-8143-42e1-8fa4-63c00a1c214f admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.091544 Jul 18 10:44:50.782818 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 18 10:44:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 10:45:02.110001 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-1f460e55-a030-4256-a21f-91297e416c30 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:02.111239 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-1f460e55-a030-4256-a21f-91297e416c30 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 Jul 18 10:45:02.111886 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 18 10:45:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:45:02.261498 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG dbcounter [-] [110404] Writing DB stats nova_cell0:SELECT=4 {{(pid=110404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:02.262248 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG dbcounter [-] [110404] Writing DB stats nova_cell1:SELECT=4 {{(pid=110404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:02.263144 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG dbcounter [-] [110404] Writing DB stats nova_api:SELECT=8 {{(pid=110404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:02.318850 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-f38c0ead-b8b0-48cc-a295-9c825161efa5 admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:02.320352 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:45:02.320352 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: warnings.warn(msg) Jul 18 10:45:02.321775 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-f38c0ead-b8b0-48cc-a295-9c825161efa5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:02.322265 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-f38c0ead-b8b0-48cc-a295-9c825161efa5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:02.323012 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-f38c0ead-b8b0-48cc-a295-9c825161efa5 admin admin] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:02.323442 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-f38c0ead-b8b0-48cc-a295-9c825161efa5 admin admin] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:02.349484 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-f38c0ead-b8b0-48cc-a295-9c825161efa5 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.094137 Jul 18 10:45:02.350051 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 18 10:45:02 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:03.207250 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: DEBUG nova.api.openstack.wsgi [None req-1f460e55-a030-4256-a21f-91297e416c30 admin admin] Calling method '>' {{(pid=110405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:03.208251 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: INFO nova.api.openstack.requestlog [None req-1f460e55-a030-4256-a21f-91297e416c30 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 18 10:45:03.208644 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: [pid: 110405|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 18 10:45:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:45:03.406815 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG nova.api.openstack.wsgi [None req-647f7470-449b-46ee-8289-d60051420320 admin admin] Calling method '>' {{(pid=110404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:03.408038 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:45:03.408038 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: warnings.warn(msg) Jul 18 10:45:03.409308 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-647f7470-449b-46ee-8289-d60051420320 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:03.409754 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-647f7470-449b-46ee-8289-d60051420320 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:03.410544 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-647f7470-449b-46ee-8289-d60051420320 admin admin] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:03.410975 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: DEBUG oslo_concurrency.lockutils [None req-647f7470-449b-46ee-8289-d60051420320 admin admin] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:03.434471 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: INFO nova.api.openstack.requestlog [None req-647f7470-449b-46ee-8289-d60051420320 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084141 Jul 18 10:45:03.435055 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: [pid: 110404|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 18 10:45:03 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:03.917782 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: Mon Jul 18 10:46:03 2022 - graceful shutdown triggered... Jul 18 10:46:03.917834 dv-cinder-849498-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 18 10:46:03.918793 dv-cinder-849498-1-iscsi devstack@n-api.service[110405]: Gracefully killing worker 2 (pid: 110405)... Jul 18 10:46:03.919227 dv-cinder-849498-1-iscsi devstack@n-api.service[110404]: Gracefully killing worker 1 (pid: 110404)... Jul 18 10:46:04.919646 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: worker 1 buried after 1 seconds Jul 18 10:46:04.919646 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: worker 2 buried after 1 seconds Jul 18 10:46:04.919646 dv-cinder-849498-1-iscsi devstack@n-api.service[110403]: goodbye to uWSGI. Jul 18 10:46:04.921735 dv-cinder-849498-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 18 10:46:04.922547 dv-cinder-849498-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 18 10:46:04.925827 dv-cinder-849498-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 10:46:04.935900 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 10:46:04.938766 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 10:46:04 2022] *** Jul 18 10:46:04.939041 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 10:46:04.939239 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 10:46:04.939351 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: nodename: dv-cinder-849498-1-iscsi Jul 18 10:46:04.939482 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: machine: x86_64 Jul 18 10:46:04.939595 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: clock source: unix Jul 18 10:46:04.939721 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: pcre jit disabled Jul 18 10:46:04.939721 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: detected number of CPU cores: 4 Jul 18 10:46:04.939721 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: current working directory: / Jul 18 10:46:04.939721 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: detected binary path: /usr/bin/uwsgi-core Jul 18 10:46:04.939721 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: your processes number limit is 47680 Jul 18 10:46:04.939721 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: your memory page size is 4096 bytes Jul 18 10:46:04.939721 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: detected max file descriptor number: 2048 Jul 18 10:46:04.939721 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: lock engine: pthread robust mutexes Jul 18 10:46:04.940283 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: thunder lock: enabled Jul 18 10:46:04.940283 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 10:46:04.940283 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 10:46:04.985122 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: Python main interpreter initialized at 0x560f8c9f89c0 Jul 18 10:46:04.985122 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: python threads support enabled Jul 18 10:46:04.985122 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: your server socket listen backlog is limited to 100 connections Jul 18 10:46:04.985122 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: your mercy for graceful operations on workers is 90 seconds Jul 18 10:46:04.985524 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 10:46:04.985524 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: *** Operational MODE: preforking *** Jul 18 10:46:05.004682 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: *** uWSGI is running in multiple interpreter mode *** Jul 18 10:46:05.004682 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: spawned uWSGI master process (pid: 124984) Jul 18 10:46:05.004682 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: spawned uWSGI worker 1 (pid: 125005, cores: 1) Jul 18 10:46:05.004682 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: spawned uWSGI worker 2 (pid: 125007, cores: 1) Jul 18 10:46:05.004682 dv-cinder-849498-1-iscsi devstack@n-api.service[124984]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 10:46:04.985792 dv-cinder-849498-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 10:46:05.692105 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 10:46:05.693218 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 10:46:06.935536 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:46:06.935536 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: from cryptography.utils import int_from_bytes Jul 18 10:46:06.937884 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:46:06.937884 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: from cryptography.utils import int_from_bytes Jul 18 10:46:06.957139 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:46:06.957139 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: from cryptography.utils import int_from_bytes Jul 18 10:46:06.958038 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:46:06.958038 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: from cryptography.utils import int_from_bytes Jul 18 10:46:09.486285 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:46:09.487297 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:46:09.487297 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:46:09.487576 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:46:09.487975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:46:09.488136 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.488461 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.488811 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.489155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.489498 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.490380 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.490801 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.491369 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.491778 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.492046 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.492350 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.492680 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849498-1-iscsi {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.493035 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.493348 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.493671 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.493998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.494307 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.494632 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.494936 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.495455 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.498052 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.498052 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.498052 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.498052 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.498052 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.498052 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.498052 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.500653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.500653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.500653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.500653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849498-1-iscsi {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.500653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.500653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.500653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.500653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.503807 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.503807 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.503807 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.503807 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.503807 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.503807 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.503807 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.503807 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.505959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.505959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.505959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.505959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.505959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.505959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.505959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.505959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.508629 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.508629 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.508629 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.508629 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.508629 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.508629 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.508629 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.510377 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.510377 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.510377 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.510377 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.510377 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.510377 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.510377 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.511873 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.511873 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.511873 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.511873 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.511873 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.513073 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.513073 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.513073 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.513073 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.514007 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.514007 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.514007 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.514766 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.514766 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.514766 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.515436 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.515436 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.515885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.516112 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.516346 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.516577 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.516849 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.517154 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.518294 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.518294 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.518752 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:46:09.519536 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.519882 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:46:09.520146 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.520146 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.520146 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.520883 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:46:09.521165 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.521165 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.521659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:46:09.521921 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.521921 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.522432 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:46:09.522671 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.522671 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.523172 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.523443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.523443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.523977 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.524293 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.524559 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.524904 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.525166 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.525426 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.525426 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.525928 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.526224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.526224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.526706 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.526968 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.526968 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.527532 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.528567 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.528567 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.529099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.529345 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.529345 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.529844 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.530099 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.530354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.530608 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.530608 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.531076 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.531326 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.531326 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.531856 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849498-1-iscsi {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.532112 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.532112 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.532600 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.532905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.532905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.533398 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.533697 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.533697 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.534159 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.534409 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.534409 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.534889 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.535136 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.535386 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.535633 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.535881 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.536151 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.536151 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.537240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.537495 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.537495 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.537495 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.539051 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.539343 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.539343 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.539826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.540086 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.540365 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.540623 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.540623 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.541308 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.541751 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.541998 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.542239 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.542239 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.542718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.542978 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.543287 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.543531 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.543786 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.544047 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.544047 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.544518 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.544758 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.545048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.545303 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.545561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.545812 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.546053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849498-1-iscsi {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.546293 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.546556 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.546796 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.547069 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.547320 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.547558 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.547808 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.547808 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.548327 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.549561 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.549561 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.550036 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.550276 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.550276 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.550793 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.551047 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.551306 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.551546 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.551803 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.552042 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.552042 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.554697 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.555024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.555024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.555553 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.555824 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.556321 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.556728 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.556728 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.557340 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.557616 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.557616 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.558132 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.558397 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.558397 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.559755 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.560146 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.560420 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.560688 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.560688 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.561203 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.561500 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.561757 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.562027 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.562295 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.562545 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.562545 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.563047 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.563299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.563551 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.563814 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.564068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.564341 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.564616 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.564968 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.564968 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.565465 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.565729 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.565980 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.566308 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.566561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.566835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.566835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.567328 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.567713 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.568511 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.568815 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.570037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.570309 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.570309 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.570818 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.571075 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.571325 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.571593 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.571895 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.572176 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.572176 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.572673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.572973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.572973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.573474 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.573783 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.573783 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.574320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.574572 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.574825 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.575072 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.575072 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.575585 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.575849 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.575849 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.576373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.576681 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.577114 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.577370 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.577632 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.583138 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.583138 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.584386 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.584652 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.584652 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.585265 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.585529 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.585529 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.586084 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.586343 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.586343 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.586855 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.587112 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.587381 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.587648 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.587648 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.588250 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.588582 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.588896 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.589190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.589190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.589784 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.590054 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.590054 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.590564 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.590841 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.590841 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.591360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.591657 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.592842 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.593139 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.593395 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.593661 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.593960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.594218 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.594218 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.594821 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.595090 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.595090 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.595594 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.595848 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.595848 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.596328 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.596591 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.596591 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.597123 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.597399 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.597399 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.598142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.598405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.598674 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.598927 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.598927 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.599939 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.600248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.600552 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.600886 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.601147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.601480 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.601749 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.602036 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.602036 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.603385 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.603643 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.603643 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.604152 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.604418 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.604688 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.604988 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.605256 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.605510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.605796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.606062 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.606336 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.606598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.606883 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.607144 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.607397 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.607648 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.607922 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.608173 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.608496 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.608746 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.608746 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.609320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.609575 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.609575 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.610054 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.610303 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.610551 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.610551 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.611055 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.611320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.611573 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.611843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.612096 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.612358 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.614842 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.615113 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.615393 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.615393 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.615901 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.616172 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.616428 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.616682 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.616992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.617249 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.617516 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.617791 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.617791 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.618307 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.618574 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.618826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.619091 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.619361 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.619614 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.619940 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.620193 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.620457 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.620717 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.621053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.621306 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.621306 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.621833 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.622097 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.622345 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.622610 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.622877 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.623156 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.623156 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.623638 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.624754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.624754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.625305 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.625773 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.626048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.626322 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.626322 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.626808 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.627085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.627353 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.627603 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.627858 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.628108 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.628108 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.628617 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.628956 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.629226 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.629509 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.629509 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.630016 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.630926 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.630926 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.631452 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.631704 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.631959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.632212 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.632537 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.632836 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.632836 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.633356 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:46:09.633647 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.633647 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.634169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.636566 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.636566 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.637254 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.637658 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.637658 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.638244 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.638516 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.638516 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.639045 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.639308 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.639308 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.639850 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.640107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.640107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.640596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.641007 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.641007 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.641529 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.641783 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.641783 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.642573 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.642929 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.642929 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.643469 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.643736 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.643736 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.644240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.644542 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.645551 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.645814 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.645814 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.646376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.647174 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.647174 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.647687 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.647973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.647973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.648542 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.648824 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.648824 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.649349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.649601 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.649601 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.650109 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.650378 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.650378 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.650865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.651119 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.651400 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.651654 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.651654 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.652160 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.652604 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.652604 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.653202 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.653479 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.653479 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.654507 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.654764 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.655045 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.655949 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.655949 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.656468 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.656737 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.656737 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.657308 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.657560 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.657814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.658081 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.658081 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.658081 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.658838 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.659095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.659367 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.659639 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.659639 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.660132 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.660405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.660405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.660405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.661229 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.661544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.661544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.662081 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.662345 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.662632 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.663096 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.663096 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.663596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.663860 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.663860 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.664350 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.664615 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.664615 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.665157 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.665445 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.665445 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.666609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.666878 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.666878 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.667412 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.667667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.667667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.668187 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.668442 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.668442 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.669031 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.669297 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.669297 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.669783 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.670043 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.670043 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.670986 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.671255 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.671255 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.671765 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.672021 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.672021 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.672536 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.672831 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.672831 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.673499 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.673761 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.673761 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.674284 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.674664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.674664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.675159 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.675426 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.675426 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.675945 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.676860 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.676860 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.677403 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.677670 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.677943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.678208 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.678208 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.678712 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.678963 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.678963 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.679459 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.679722 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.679986 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.680314 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.680314 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.681057 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.681319 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.681319 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.681796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.682090 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.682090 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.682586 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.682852 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.682852 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.683512 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.683785 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.683785 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.684260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.684581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.684759 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.685062 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.685062 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.685535 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.687405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.687405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.687903 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.688148 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.688148 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.688731 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.688988 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.688988 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.689417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.689699 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.689699 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.693544 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.695879 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.695879 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.696318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.696537 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.696537 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.696985 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.697243 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.697243 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.697702 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.697927 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.697927 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.698344 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.698581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.698581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.698996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.699269 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.699269 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.699684 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.699910 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.700127 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.700384 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.700384 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.700817 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.701034 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.701034 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.701473 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.701685 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.701685 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.702167 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.702382 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.702382 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.705209 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.706302 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.706302 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.706731 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.706947 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.706947 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.707400 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.707658 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.707658 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.708091 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.708318 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.709229 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.710637 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.710637 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.710924 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.711042 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.711042 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.711261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.711373 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.711373 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.711614 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.711756 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.711756 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.712121 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.713780 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.713780 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.714105 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.714246 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.714246 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.714501 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.714647 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.714647 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.714932 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.715063 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.715063 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.715305 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.715443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.715572 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.715707 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.715707 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.715977 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.716182 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.716182 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.716452 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.716580 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.716580 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.716870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.717015 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.717015 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.717276 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.717414 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.717583 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.717714 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.717714 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.717978 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.718107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.718107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.718364 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.718492 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.718492 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.718753 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.718934 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.718934 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.719192 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.719368 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.719557 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.719697 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.719697 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.719942 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.720076 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.720076 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.720351 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.720491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.720491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.720743 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.720894 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.720894 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.721154 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.721290 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.721290 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.721290 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.721290 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.721769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.721925 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.722114 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.722251 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.722389 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.722508 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.722508 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.723087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.723268 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.723268 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.724177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.724328 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.724328 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.724583 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.724751 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.724751 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.725270 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.725429 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.725429 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.725710 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.725841 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.725976 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.726120 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.726120 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.726450 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.726588 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.726588 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.726838 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.726966 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.726966 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.727223 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.727360 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.727360 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.727611 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.727763 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.728487 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.728636 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.728636 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.728971 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.729100 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.729100 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.729366 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.729495 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.729495 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.729757 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.729886 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.729886 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.730147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.730276 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.730276 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.730565 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.730772 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.730772 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.731269 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.731469 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.731469 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.731817 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.731962 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.731962 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.732207 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.732413 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.732611 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.732842 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.732842 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.732842 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.733556 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.734291 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.734291 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.734564 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.734731 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.734900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.735042 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.735042 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.735308 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.735445 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.735589 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.735719 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.735847 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.735975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.735975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.736263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.736407 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.736407 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.736662 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.736850 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.736850 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.737172 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.737303 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.737303 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.737683 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.737883 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.738019 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.738159 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.738159 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.738404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.738539 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.738539 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.738854 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.739175 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.739175 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.740608 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.740853 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.740853 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.741173 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.741304 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.741433 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.741579 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.741920 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.742078 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.742218 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.742378 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.742510 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.742648 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.742778 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.742906 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.743044 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.743181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.743319 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.743462 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.743462 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.743715 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.743988 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.744555 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.744703 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.744897 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.745057 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.745201 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.745201 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.745455 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.745455 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.745714 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.745854 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.746059 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.746266 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.746479 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.746656 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.746797 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.746935 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.747065 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.747237 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.747809 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.748033 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.748205 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.748343 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.748474 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.748611 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.748753 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.748922 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.749073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.749073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.749328 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.749459 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.749601 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.749740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.749740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.750050 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.750201 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.750201 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.750201 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.750622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.750804 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.750804 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.751184 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.751381 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.751557 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.751698 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.751835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.751981 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.752125 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.752125 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.752421 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.752421 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.752421 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.752805 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.763927 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.764185 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.764346 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.764488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.764626 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.764758 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.765004 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.765004 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.765281 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.765425 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.765425 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.765686 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.765829 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.765829 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.765829 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.765829 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.765829 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.765829 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.765829 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.765829 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.766906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.766906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.766906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.766906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.766906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.766906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.766906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.766906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.768098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.768098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.768098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.768098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.768098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.768098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.768098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.768098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.769228 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.769228 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.769228 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.769228 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.769228 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.769228 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.769228 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.769228 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.770215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.770215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.770215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.770215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.770215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.770215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.770215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.770215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.771820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.771957 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.772097 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.772097 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.772097 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.772097 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.772097 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.772097 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.772097 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.773036 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.773189 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.773189 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.773189 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.773189 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.773709 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.773844 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.773844 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.774282 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.774451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.774451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.774902 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.775078 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.775078 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.775078 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.775078 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.775078 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.776030 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.776254 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.776254 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.776254 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.776739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.776906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.776906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.776906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.776906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.777492 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.777648 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.777648 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.777648 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.777648 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.777648 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.778430 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.778595 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.778595 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.778595 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.778595 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.779367 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.779559 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.779559 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.779559 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.780232 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.780232 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.780721 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.780721 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.781255 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.781503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.781503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.781503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.781503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.781503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.781503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.781503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.783082 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.783327 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.783327 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.783327 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.783327 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.783327 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.784008 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.784167 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.784167 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.784167 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.784167 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.784751 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.784983 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.784983 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.784983 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.785473 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.785689 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.785902 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.786224 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.786224 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.786608 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.786829 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.786829 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.787215 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.787406 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.787590 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.787779 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.787779 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.788278 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.788525 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.788734 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.789008 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.789008 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.789396 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.789564 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.789730 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.789885 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.790048 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.790218 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.790218 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.790849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.790849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.791162 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.791393 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.791572 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.791737 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.791902 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.792067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.792219 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.792390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.792544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.792708 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.798501 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.798757 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.798950 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.799111 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.799111 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.799420 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.799582 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.799778 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.799953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.800122 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.800293 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.800454 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.800610 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.800610 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.801030 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.801188 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.801344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.801502 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.801502 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.801790 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.801948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.802709 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.802954 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.803144 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.803331 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.803706 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.803917 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.804081 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.804235 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.804390 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.804390 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.804690 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.804861 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.805016 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.805016 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.805308 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.805465 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.805465 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.805465 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.805910 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.806058 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.806058 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.806058 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.806058 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.806058 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.806058 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.806934 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.807094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.807094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.807383 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.807530 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.807530 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.807971 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.808141 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.808141 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.808430 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.808578 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.808578 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.808955 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.809120 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.809120 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.809412 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.809560 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.809706 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.809865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.809865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.810238 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.810386 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.810386 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.810672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.810867 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.810867 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.811183 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.811340 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.811496 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.811644 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.811644 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.811987 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.812148 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.812148 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.812395 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.812484 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.812484 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.812644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.812719 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.812719 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.812900 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.812976 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.812976 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.813127 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.813201 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.813201 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.813333 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.813421 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.813421 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.813606 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.813739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.813739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.813739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.813739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.814072 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.814159 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.814159 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.814317 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.814317 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.814541 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.814675 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.814813 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.814813 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.814813 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.814813 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.814813 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.815433 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.815566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.815705 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.815838 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.815838 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.816732 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.816900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.816900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.816900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.816900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.816900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.816900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.816900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.816900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.818467 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.818823 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.819016 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.819016 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.819016 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.819016 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.819016 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.819702 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.819846 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.819846 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.819846 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.820286 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.820431 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.820573 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.820716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.820716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.820990 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.821135 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.821135 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.821406 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.821553 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.821701 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.821839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.821839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.822107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.822248 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.822248 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.822512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.822841 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.823020 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.823155 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.823302 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.823435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.823435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.823839 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.823974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.824238 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.824352 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.824512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.825276 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.825377 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.825473 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.825568 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.825656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.825759 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.825848 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.825935 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.826031 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.826118 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.826207 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.826290 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.826365 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.826495 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.826639 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.826639 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.826639 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.826955 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.827051 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.827051 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.827218 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.827313 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.827409 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.827503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.827590 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.827682 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.827769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.827863 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.827964 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.828091 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.828195 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.828284 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.828376 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.828476 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.828564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.828657 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.828760 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.829021 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.829021 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.829021 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.829021 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.829021 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.829021 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.829021 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.829737 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.829737 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.829921 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.830009 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.830104 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.830198 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.830285 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.830386 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.830474 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.830567 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.830666 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.830754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.830848 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.830936 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.831073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.831173 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.831310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.831450 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.831598 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.831722 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.831836 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.833719 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.834548 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.834686 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.834823 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.834976 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.835112 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.835205 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.835205 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.835375 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.835463 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.835463 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.835620 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.835706 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.835706 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.835965 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.836055 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.836191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.836288 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.836288 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.836514 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.836608 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.836608 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.836878 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.837006 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.837006 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.837237 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.837387 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.837529 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.837644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.837644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.837908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.838051 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.838187 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.838327 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.838470 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.838616 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.838616 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.838891 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.839031 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.839164 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.839304 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.839304 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.839565 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.839707 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.839839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.839979 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.840112 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.840226 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.840367 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.840460 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.840561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.840650 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.840650 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.840897 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.840997 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.840997 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.841167 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.841307 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.841440 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.841590 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.841683 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.841770 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.841856 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.841856 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.841856 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.841856 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.841856 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.841856 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.841856 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.841856 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.843357 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.843471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.843561 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.843649 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.843735 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.843830 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.843933 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.844022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.844109 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.844109 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.844282 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.844384 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.844478 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.844565 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.844565 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.844721 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.844825 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.844939 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.845036 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.845185 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.845327 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.845462 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.845583 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.845583 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.845802 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.845897 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.845985 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.846078 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.846214 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.846344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.846344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.846601 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.846742 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.846742 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.846930 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.847027 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.847027 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.847200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.847296 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.847385 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.847486 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.847586 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.847714 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.848085 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.848199 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.848199 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.848434 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.848583 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.848717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.848839 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.848931 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.849120 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.849120 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.849477 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.849615 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.849710 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.849935 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.849935 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.850186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.850301 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.850301 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.850465 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.850541 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.850541 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.850690 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.850763 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.850763 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.850915 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.851053 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.851155 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.851244 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.851387 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.851487 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.851575 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.851708 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.851708 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.851975 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.852067 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.852154 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.852287 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.852398 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.852491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.852585 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.852672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.852672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.852961 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.853108 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.853108 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.853393 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.853535 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.853635 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.853724 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.853724 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.853946 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.854023 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.854106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.854206 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.854303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.854416 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.854512 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.854611 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.854698 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.854796 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.854892 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.854979 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.855072 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.855167 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.855255 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.855385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.855385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.855545 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.855668 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.855763 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.855863 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.855863 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.856042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.856138 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.856226 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.856320 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125005) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:46:09.856415 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.856415 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.856415 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.856415 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.856415 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.856415 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.856415 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.856415 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.858310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.858310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.858310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.858310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.858310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.858310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.858310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.858310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.859073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.859073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.859290 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.859506 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.859839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.860239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.861056 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.861591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.862174 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.862950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.862950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.863498 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.864002 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.864398 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.865406 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.865853 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.866234 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.866567 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.866908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.867282 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.867631 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.867956 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.868286 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.868605 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.868978 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.869301 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.869621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.869943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.870314 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.870688 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.870963 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.871305 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.871732 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.872063 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.872394 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.872717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.873089 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.873412 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.873727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.874164 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.874517 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.874895 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.875243 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.875751 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.876077 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.876438 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.876906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.877287 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.877651 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.877984 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.878312 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.878647 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.878967 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.879312 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.879667 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.880009 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.881177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.881341 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.881602 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.881845 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.882170 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.882505 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.882827 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.883284 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.883693 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.883874 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.884165 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.884506 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.885620 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.885620 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.885620 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.886117 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.886117 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.886405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.886649 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.886966 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.887274 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.887591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.887917 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.888213 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.888525 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.888870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.889180 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.889574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.890010 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.890344 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.890677 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.891004 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.891336 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.891652 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.891981 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.892313 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.892641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.892992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.896518 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.896518 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.896518 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.896518 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.896518 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.896518 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.896518 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.896518 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.897531 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.897531 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.897531 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.897531 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.897924 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.898155 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.898431 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.898771 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.899091 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.899408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.899726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.900071 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.900433 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.900758 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.901137 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.901456 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.901780 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.902105 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.902445 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.902785 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.903140 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.903475 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.903812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.904171 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.904493 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.904875 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.905275 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.905722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.906047 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.906359 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:46:09.906618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:46:10.010969 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO dbcounter [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] Registered counter for database nova_api Jul 18 10:46:10.034759 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_db.sqlalchemy.engines [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125005) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:46:10.044204 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writer thread running {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:46:10.078593 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO dbcounter [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] Registered counter for database nova_api Jul 18 10:46:10.101495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_db.sqlalchemy.engines [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:46:10.104815 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.context [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d33ec79-71c2-4367-aeee-4165661be946(cell1) {{(pid=125005) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 10:46:10.108924 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:10.109397 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writer thread running {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:46:10.110563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:10.111405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:10.113528 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:10.116532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO dbcounter [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] Registered counter for database nova_cell0 Jul 18 10:46:10.121344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO dbcounter [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] Registered counter for database nova_cell1 Jul 18 10:46:10.131024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_db.sqlalchemy.engines [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125005) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:46:10.133820 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_db.sqlalchemy.engines [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125005) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:46:10.142145 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writer thread running {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:46:10.143723 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writer thread running {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:46:10.174840 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.context [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d33ec79-71c2-4367-aeee-4165661be946(cell1) {{(pid=125007) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 10:46:10.180004 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:10.181613 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:10.182465 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:10.184897 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:10.186970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO dbcounter [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] Registered counter for database nova_cell0 Jul 18 10:46:10.191608 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO dbcounter [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] Registered counter for database nova_cell1 Jul 18 10:46:10.203185 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_db.sqlalchemy.engines [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:46:10.204316 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_db.sqlalchemy.engines [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:46:10.209462 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writer thread running {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:46:10.303050 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO dbcounter [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] Registered counter for database nova_cell0 Jul 18 10:46:10.311563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_db.sqlalchemy.engines [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125005) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:46:10.317802 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writer thread running {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:46:10.374283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writer thread running {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:46:10.384672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO dbcounter [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] Registered counter for database nova_cell0 Jul 18 10:46:10.393391 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_db.sqlalchemy.engines [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:46:10.400732 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writer thread running {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:46:10.653396 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: WARNING keystonemiddleware.auth_token [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:46:10.662116 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: WARNING keystonemiddleware.auth_token [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:46:10.899640 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: WARNING keystonemiddleware.auth_token [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:46:10.916158 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: WARNING keystonemiddleware.auth_token [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:46:11.039350 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: WARNING keystonemiddleware.auth_token [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:46:11.049928 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: WARNING keystonemiddleware.auth_token [None req-4a60d75a-979d-4fd1-a60d-cc69a72006e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:46:11.059081 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560f8c9f89c0 pid: 125005 (default app) Jul 18 10:46:11.315065 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: WARNING keystonemiddleware.auth_token [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:46:11.323200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: WARNING keystonemiddleware.auth_token [None req-6268db6e-0ffe-4f51-a569-6d30e2c14b38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:46:11.329687 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560f8c9f89c0 pid: 125007 (default app) Jul 18 10:47:16.442856 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=3 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:16.447544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=3 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:16.448749 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=3 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:16.453263 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=3 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:17.739617 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-303799926", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:18.192582 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=3 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:18.197420 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=3 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:18.210244 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=3 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:18.220163 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=3 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:19.338951 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.network.neutron [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] validate_networks() for [('09160d22-0418-499d-83b3-2657454003a1', None, None, None, None, None)] {{(pid=125005) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:47:20.449671 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3fc884e2-b999-4974-a104-50bec590a2c9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Action: 'create', calling method: .version_select at 0x7f6366d6d9d0>, body: {"keypair": {"name": "tempest-keypair-1574716326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWXdKulnkxmjEA8qtHt1oKJUeZk7MTLuwwbj6luNQJ3gqYLx/bJufZDFSBrVMcCO2EJH499eRwpKyX/oldiLsVVxz1ipa8S/jPr2qEvkc3QZxU9XRMCba5o/++xow4SEQ=="}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:20.551300 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-3fc884e2-b999-4974-a104-50bec590a2c9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Getting quotas for project f32dc706424247d0ac1dc7a6aa633107. Resources: {'key_pairs'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:47:20.573995 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-3fc884e2-b999-4974-a104-50bec590a2c9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Getting quotas for user 3dbb489073d94425ad1a1b350768c428 and project f32dc706424247d0ac1dc7a6aa633107. Resources: {'key_pairs'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:47:20.825943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3fc884e2-b999-4974-a104-50bec590a2c9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 2.640883 Jul 18 10:47:20.829440 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 18 10:47:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 2644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:21.883874 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b06361b0-ce49-4ffe-b0b8-04477c7c898f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Action: 'create', calling method: .version_select at 0x7f6366b05b80>, body: {"keypair": {"name": "tempest-keypair-1650786775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqBrGsGXJrYJw2i/NCG6fay1B3vdHzXBiktbXovnawlOiY/+bxmyQN6UZ0bY3g+cplKk+iQZfCsm4299/GRFCNDCK6VePgu35bigN6wR13tsnFYUCqsClGmFLcYEY9tyA=="}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:21.944754 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-b06361b0-ce49-4ffe-b0b8-04477c7c898f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Getting quotas for project 48497435674b41ccb34f6ff43026a232. Resources: {'key_pairs'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:47:21.974641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-b06361b0-ce49-4ffe-b0b8-04477c7c898f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Getting quotas for user 7e032c8e5b024fa7a41cd1090e0f1ada and project 48497435674b41ccb34f6ff43026a232. Resources: {'key_pairs'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:47:22.138567 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b06361b0-ce49-4ffe-b0b8-04477c7c898f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.307727 Jul 18 10:47:22.139201 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 2/2] 10.222.0.49 () {62 vars in 1199 bytes} [Mon Jul 18 10:47:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1311 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 10:47:22.915396 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-c6ca41b4-916f-4ea2-8c3a-4e9fbcf4a93f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Action: 'create', calling method: .version_select at 0x7f63662c31f0>, body: {"keypair": {"name": "tempest-keypair-677207848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECD+hPf2NeCIev4qNx+0ph2wEtXrFC3fCt0nJuR8TEVfgxv+GbUAMI0qZzOEVJ2k+IvLG2cAgxLQA0XhKgOKEGGF60cR5dtha/e9QFQcbWAIi8El4OqSfZM+H/BnSQkKA=="}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:22.953639 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-c6ca41b4-916f-4ea2-8c3a-4e9fbcf4a93f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'key_pairs'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:47:22.990287 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-c6ca41b4-916f-4ea2-8c3a-4e9fbcf4a93f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for user 3954fd4abf6b4c3a82280c762292a3e7 and project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'key_pairs'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:47:23.256973 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-c6ca41b4-916f-4ea2-8c3a-4e9fbcf4a93f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.116545 Jul 18 10:47:23.258599 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 3/3] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 18 10:47:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:23.354175 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-962440053", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "networks": [{"uuid": "8facd695-f9d6-4e5e-8364-4f0d87722f61"}]}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:23.538332 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Flavor limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:47:23.538805 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Image limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:47:23.539866 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Flavor pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:47:23.540983 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Image pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:47:23.541549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:47:23.595415 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:23.596040 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:23.597434 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:23.602546 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:23.695956 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Getting quotas for project 7184d0f3256344a2af18c639787e538f. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:47:23.707449 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Getting quotas for user e7a738986f87470681c6a578599a089f and project 7184d0f3256344a2af18c639787e538f. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:47:23.774082 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Going to run 1 instances... {{(pid=125005) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:47:23.781958 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125005) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:47:23.805382 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.network.neutron [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] validate_networks() for [('8facd695-f9d6-4e5e-8364-4f0d87722f61', None, None, None, None, None)] {{(pid=125007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:47:24.060428 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-73a2df1e-511f-40b7-81d5-fd9e3e9bc56b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.644911 Jul 18 10:47:24.068871 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 1/4] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:47:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 7659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:47:24.089181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9bcaee77-5541-45ef-bba6-996e1723a087 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:24.101106 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-9bcaee77-5541-45ef-bba6-996e1723a087 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:24.505267 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9bcaee77-5541-45ef-bba6-996e1723a087 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:24.554737 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9bcaee77-5541-45ef-bba6-996e1723a087 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1221 microversion: 2.1 time: 0.483895 Jul 18 10:47:24.569366 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 2/5] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:24 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1221 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:24.867467 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-522147749", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:24.962079 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.network.neutron [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] validate_networks() for [('09160d22-0418-499d-83b3-2657454003a1', None, None, None, None, None)] {{(pid=125005) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:47:28.625767 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Flavor limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:47:28.626555 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Image limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:47:28.626662 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Flavor pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:47:28.627039 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Image pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:47:28.627800 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:47:28.653613 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.660079 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.661276 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.664190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.671686 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Flavor limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:47:28.673494 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Image limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:47:28.673494 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Flavor pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:47:28.673494 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Image pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:47:28.674077 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:47:28.692157 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.697613 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.704390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.705056 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.744908 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Getting quotas for project 7184d0f3256344a2af18c639787e538f. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:47:28.756128 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Getting quotas for user e7a738986f87470681c6a578599a089f and project 7184d0f3256344a2af18c639787e538f. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:47:28.786632 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Getting quotas for project 6d288974aac54fa681cfafa262d019eb. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:47:28.788609 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Going to run 1 instances... {{(pid=125005) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:47:28.794406 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125005) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:47:28.809599 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Getting quotas for user ce15ddb712fa42dc8d487fe22d0959bd and project 6d288974aac54fa681cfafa262d019eb. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:47:28.838404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Going to run 1 instances... {{(pid=125007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:47:28.846598 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:47:29.038210 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8cfceac8-7ec2-4b76-966f-57346e7f902e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.179262 Jul 18 10:47:29.039506 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 3/6] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:47:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 4183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:47:29.062522 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7d3b90c8-fa70-4bd4-8a92-6c254c490b09 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:29.063681 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-7d3b90c8-fa70-4bd4-8a92-6c254c490b09 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:29.085769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-0658ee4b-540a-42fe-970d-24b66886bb1d tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.825586 Jul 18 10:47:29.087116 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 4/7] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:47:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 5828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:47:29.103106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-090007c1-4806-42e8-ab4c-3b4d160e8dd4 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:29.104176 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-090007c1-4806-42e8-ab4c-3b4d160e8dd4 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:29.259065 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7d3b90c8-fa70-4bd4-8a92-6c254c490b09 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:29.288448 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7d3b90c8-fa70-4bd4-8a92-6c254c490b09 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1221 microversion: 2.1 time: 0.229901 Jul 18 10:47:29.290376 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:29 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1221 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:29.402111 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-090007c1-4806-42e8-ab4c-3b4d160e8dd4 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:29.473106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-090007c1-4806-42e8-ab4c-3b4d160e8dd4 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1214 microversion: 2.1 time: 0.358437 Jul 18 10:47:29.473106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 5/9] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:29 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1214 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:30.326979 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b7ffe587-66c4-477a-b9e0-4197cc2f1003 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:30.333671 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b7ffe587-66c4-477a-b9e0-4197cc2f1003 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:30.340834 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1926453137", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c1c65d9-29f8-4dd0-b3fd-1aaa05a8fb81"}], "security_groups": [{"name": "tempest-securitygroup--156915885"}], "key_name": "tempest-keypair-1574716326", "user_data": "}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:30.696849 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-b7ffe587-66c4-477a-b9e0-4197cc2f1003 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:30.708715 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b7ffe587-66c4-477a-b9e0-4197cc2f1003 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1221 microversion: 2.1 time: 0.388522 Jul 18 10:47:30.714640 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 5/10] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:30 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1221 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:30.761317 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-de3c9bcb-d66e-4e52-817f-d98abd2e15d5 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:30.762382 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-de3c9bcb-d66e-4e52-817f-d98abd2e15d5 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:31.100509 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-de3c9bcb-d66e-4e52-817f-d98abd2e15d5 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:31.116287 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-de3c9bcb-d66e-4e52-817f-d98abd2e15d5 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1214 microversion: 2.1 time: 0.395210 Jul 18 10:47:31.130112 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 6/11] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:30 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1214 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:31.157037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.network.neutron [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] validate_networks() for [('2c1c65d9-29f8-4dd0-b3fd-1aaa05a8fb81', None, None, None, None, None)] {{(pid=125007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:47:31.737101 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-0f2f5f42-e394-43d2-9237-68de80c027b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:31.742444 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-0f2f5f42-e394-43d2-9237-68de80c027b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:31.764608 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0f2f5f42-e394-43d2-9237-68de80c027b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:31.767798 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0f2f5f42-e394-43d2-9237-68de80c027b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:31.772384 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0f2f5f42-e394-43d2-9237-68de80c027b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:31.773708 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0f2f5f42-e394-43d2-9237-68de80c027b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:32.638199 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0f2f5f42-e394-43d2-9237-68de80c027b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:32.674293 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-0f2f5f42-e394-43d2-9237-68de80c027b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1225 microversion: 2.1 time: 0.942806 Jul 18 10:47:32.687984 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 7/12] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:31 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1225 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:32.701740 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-355c83d8-2c88-4671-8881-13163310ab0c tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:32.703853 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-355c83d8-2c88-4671-8881-13163310ab0c tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:32.717601 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-355c83d8-2c88-4671-8881-13163310ab0c tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:32.718296 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-355c83d8-2c88-4671-8881-13163310ab0c tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:32.719305 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-355c83d8-2c88-4671-8881-13163310ab0c tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:32.719903 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-355c83d8-2c88-4671-8881-13163310ab0c tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:32.965061 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-355c83d8-2c88-4671-8881-13163310ab0c tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:32.986654 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-355c83d8-2c88-4671-8881-13163310ab0c tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1210 microversion: 2.1 time: 0.296566 Jul 18 10:47:32.989578 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 8/13] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:32 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1210 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:33.558153 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Flavor limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:47:33.558153 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Image limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:47:33.558153 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Flavor pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:47:33.558153 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Image pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:47:33.558153 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:47:33.560752 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.560752 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.560752 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.560752 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.561290 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Getting quotas for project f32dc706424247d0ac1dc7a6aa633107. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:47:33.583375 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Getting quotas for user 3dbb489073d94425ad1a1b350768c428 and project f32dc706424247d0ac1dc7a6aa633107. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:47:33.661667 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Going to run 1 instances... {{(pid=125007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:47:33.671218 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:47:33.732623 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b9f7b8e2-de27-4109-9ad2-f378c03d99e5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:33.733318 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b9f7b8e2-de27-4109-9ad2-f378c03d99e5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:33.776696 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b9f7b8e2-de27-4109-9ad2-f378c03d99e5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.780815 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b9f7b8e2-de27-4109-9ad2-f378c03d99e5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.780815 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b9f7b8e2-de27-4109-9ad2-f378c03d99e5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.781425 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b9f7b8e2-de27-4109-9ad2-f378c03d99e5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.950801 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-b9f7b8e2-de27-4109-9ad2-f378c03d99e5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:34.012005 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b9f7b8e2-de27-4109-9ad2-f378c03d99e5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1273 microversion: 2.1 time: 0.291108 Jul 18 10:47:34.016874 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 9/14] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:33 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1273 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:34.041549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-0b3fd948-cd52-4978-bdd2-0f7e4bc236f2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:34.046493 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-0b3fd948-cd52-4978-bdd2-0f7e4bc236f2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:34.050635 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-13eea8ed-e7f6-4886-9358-c6e4f9b10df0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.715273 Jul 18 10:47:34.056288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 6/15] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:47:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 3723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 10:47:34.086182 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-dbec40f9-2342-41ca-b0ee-4332b775e183 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:34.089244 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-dbec40f9-2342-41ca-b0ee-4332b775e183 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:34.095222 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b3fd948-cd52-4978-bdd2-0f7e4bc236f2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:34.095709 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b3fd948-cd52-4978-bdd2-0f7e4bc236f2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:34.105667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b3fd948-cd52-4978-bdd2-0f7e4bc236f2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:34.106177 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b3fd948-cd52-4978-bdd2-0f7e4bc236f2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:34.316651 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-dbec40f9-2342-41ca-b0ee-4332b775e183 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:34.319318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-dbec40f9-2342-41ca-b0ee-4332b775e183 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1238 microversion: 2.1 time: 0.253647 Jul 18 10:47:34.320407 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 7/16] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:34 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1238 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:34.418699 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0b3fd948-cd52-4978-bdd2-0f7e4bc236f2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:34.431221 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-0b3fd948-cd52-4978-bdd2-0f7e4bc236f2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1266 microversion: 2.1 time: 0.412963 Jul 18 10:47:34.446336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 10/17] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:34 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1266 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:35.041212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8f5229ad-984b-43de-9a22-07794c3c5ccf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:35.042733 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-8f5229ad-984b-43de-9a22-07794c3c5ccf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:35.067549 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f5229ad-984b-43de-9a22-07794c3c5ccf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:35.068386 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f5229ad-984b-43de-9a22-07794c3c5ccf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:35.069970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f5229ad-984b-43de-9a22-07794c3c5ccf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:35.076427 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f5229ad-984b-43de-9a22-07794c3c5ccf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:35.234276 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1447698536", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cacd27b7-b866-4702-aa51-5895ad956ffc"}], "security_groups": [{"name": "tempest-securitygroup--846297287"}], "key_name": "tempest-keypair-1650786775", "user_data": "}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:36.996482 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-8f5229ad-984b-43de-9a22-07794c3c5ccf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:37.078364 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-8f5229ad-984b-43de-9a22-07794c3c5ccf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1281 microversion: 2.1 time: 2.047106 Jul 18 10:47:37.085232 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 8/18] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:35 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1281 bytes in 2055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:37.116612 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3402a8ac-5e09-4538-827a-e093d98002e1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:37.119832 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3402a8ac-5e09-4538-827a-e093d98002e1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:37.149589 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3402a8ac-5e09-4538-827a-e093d98002e1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:37.159929 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3402a8ac-5e09-4538-827a-e093d98002e1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:37.161437 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3402a8ac-5e09-4538-827a-e093d98002e1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:37.168871 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3402a8ac-5e09-4538-827a-e093d98002e1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:37.557546 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3402a8ac-5e09-4538-827a-e093d98002e1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:37.598871 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3402a8ac-5e09-4538-827a-e093d98002e1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1242 microversion: 2.1 time: 0.511783 Jul 18 10:47:37.605562 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 9/19] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:37 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1242 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:37.622814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-bed0d570-b185-42c9-b929-dd0f40aea6ab tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:37.626786 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-bed0d570-b185-42c9-b929-dd0f40aea6ab tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:37.632014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.network.neutron [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] validate_networks() for [('cacd27b7-b866-4702-aa51-5895ad956ffc', None, None, None, None, None)] {{(pid=125005) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:47:37.667451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bed0d570-b185-42c9-b929-dd0f40aea6ab tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:37.667920 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bed0d570-b185-42c9-b929-dd0f40aea6ab tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:37.674045 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bed0d570-b185-42c9-b929-dd0f40aea6ab tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:37.675273 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bed0d570-b185-42c9-b929-dd0f40aea6ab tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:38.332407 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-bed0d570-b185-42c9-b929-dd0f40aea6ab tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:38.343986 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-bed0d570-b185-42c9-b929-dd0f40aea6ab tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1272 microversion: 2.1 time: 0.737086 Jul 18 10:47:38.354653 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 10/20] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:37 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1272 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:38.371137 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9e382af2-afa5-4049-963c-a0fe3f4f58fe tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:38.372727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9e382af2-afa5-4049-963c-a0fe3f4f58fe tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:38.385345 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e382af2-afa5-4049-963c-a0fe3f4f58fe tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:38.385345 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e382af2-afa5-4049-963c-a0fe3f4f58fe tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:38.385345 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e382af2-afa5-4049-963c-a0fe3f4f58fe tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:38.385345 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e382af2-afa5-4049-963c-a0fe3f4f58fe tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:38.702968 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=4 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:38.723243 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9e382af2-afa5-4049-963c-a0fe3f4f58fe tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:38.765672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9e382af2-afa5-4049-963c-a0fe3f4f58fe tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1279 microversion: 2.1 time: 0.408850 Jul 18 10:47:38.793804 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 11/21] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:38 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1279 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:38.844734 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a3601298-c471-40f7-accc-af625c593d50 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:38.847253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a3601298-c471-40f7-accc-af625c593d50 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:38.921547 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a3601298-c471-40f7-accc-af625c593d50 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:38.921547 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a3601298-c471-40f7-accc-af625c593d50 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:38.921547 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a3601298-c471-40f7-accc-af625c593d50 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:38.921547 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a3601298-c471-40f7-accc-af625c593d50 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:39.592712 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a3601298-c471-40f7-accc-af625c593d50 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:39.613810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a3601298-c471-40f7-accc-af625c593d50 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1290 microversion: 2.1 time: 0.807498 Jul 18 10:47:39.626507 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 12/22] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:38 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1290 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:39.649378 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-61579320", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfde60e0-9a8e-4b4d-8a28-cc720005757b"}], "security_groups": [{"name": "tempest-securitygroup--2037182630"}], "key_name": "tempest-keypair-677207848", "user_data": "}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:40.101442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.network.neutron [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] validate_networks() for [('cfde60e0-9a8e-4b4d-8a28-cc720005757b', None, None, None, None, None)] {{(pid=125007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:47:41.077884 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Flavor limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:47:41.079848 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Image limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:47:41.081685 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Flavor pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:47:41.083003 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Image pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:47:41.084675 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:47:41.108994 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=20 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:41.142638 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:41.144264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:41.146278 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:41.148152 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:41.237942 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Getting quotas for project 48497435674b41ccb34f6ff43026a232. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:47:41.259573 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Getting quotas for user 7e032c8e5b024fa7a41cd1090e0f1ada and project 48497435674b41ccb34f6ff43026a232. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:47:41.335930 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Going to run 1 instances... {{(pid=125005) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:47:41.358378 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125005) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:47:41.900174 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-df0cb2fc-89ba-4112-b748-c2bc1a62ee6d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 6.673548 Jul 18 10:47:41.909151 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 11/23] 10.222.0.49 () {62 vars in 1187 bytes} [Mon Jul 18 10:47:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 6683 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 18 10:47:41.920802 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f93d01fd-5165-4f60-97c7-e32c85f4bd94 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:41.922150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f93d01fd-5165-4f60-97c7-e32c85f4bd94 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:41.937083 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f93d01fd-5165-4f60-97c7-e32c85f4bd94 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:41.938560 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f93d01fd-5165-4f60-97c7-e32c85f4bd94 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:41.942123 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f93d01fd-5165-4f60-97c7-e32c85f4bd94 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:41.944123 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f93d01fd-5165-4f60-97c7-e32c85f4bd94 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:43.493236 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=4 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:43.527401 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Flavor limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:47:43.532878 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Image limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:47:43.532878 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Flavor pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:47:43.532878 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Image pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:47:43.532878 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:47:43.564048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:43.571916 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:43.580314 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:43.581605 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:43.661494 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:47:43.701336 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for user 3954fd4abf6b4c3a82280c762292a3e7 and project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:47:43.729989 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:43.774895 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Going to run 1 instances... {{(pid=125007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:47:43.784697 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:47:44.198336 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2ac15f43-7c90-4aa9-a020-cef9e0f5899e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.567357 Jul 18 10:47:44.203859 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 13/24] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:47:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 4576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:47:44.246612 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-81d45340-ae1d-48e7-b18c-9671f872ed52 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:44.249652 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-81d45340-ae1d-48e7-b18c-9671f872ed52 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:44.313460 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-81d45340-ae1d-48e7-b18c-9671f872ed52 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:44.314099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-81d45340-ae1d-48e7-b18c-9671f872ed52 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:44.325180 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-81d45340-ae1d-48e7-b18c-9671f872ed52 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:44.326541 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-81d45340-ae1d-48e7-b18c-9671f872ed52 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:44.387617 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f93d01fd-5165-4f60-97c7-e32c85f4bd94 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:44.436711 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f93d01fd-5165-4f60-97c7-e32c85f4bd94 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1314 microversion: 2.1 time: 2.525824 Jul 18 10:47:44.437624 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 12/25] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:41 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1314 bytes in 2527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:44.459691 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2d090327-b5a7-4185-bc2f-834f09112eaf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:44.460325 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2d090327-b5a7-4185-bc2f-834f09112eaf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:44.525933 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2d090327-b5a7-4185-bc2f-834f09112eaf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:44.526396 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2d090327-b5a7-4185-bc2f-834f09112eaf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:44.527251 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2d090327-b5a7-4185-bc2f-834f09112eaf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:44.527810 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2d090327-b5a7-4185-bc2f-834f09112eaf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:45.934361 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-81d45340-ae1d-48e7-b18c-9671f872ed52 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:45.946826 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-2d090327-b5a7-4185-bc2f-834f09112eaf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:45.979214 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-81d45340-ae1d-48e7-b18c-9671f872ed52 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1321 microversion: 2.1 time: 1.755275 Jul 18 10:47:45.982563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2d090327-b5a7-4185-bc2f-834f09112eaf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1363 microversion: 2.1 time: 1.527316 Jul 18 10:47:45.983384 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 13/26] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:44 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1363 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:45.983809 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 14/27] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:44 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1321 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:45.989864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-cf9484ef-6378-4def-a35e-53c5bc9f5dee tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:46.019728 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8d1ca3d1-63a6-4f32-aa27-596c520623fe tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:46.029224 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-cf9484ef-6378-4def-a35e-53c5bc9f5dee tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:46.030314 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8d1ca3d1-63a6-4f32-aa27-596c520623fe tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:46.055849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cf9484ef-6378-4def-a35e-53c5bc9f5dee tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:46.056254 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cf9484ef-6378-4def-a35e-53c5bc9f5dee tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:46.064134 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cf9484ef-6378-4def-a35e-53c5bc9f5dee tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:46.067619 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cf9484ef-6378-4def-a35e-53c5bc9f5dee tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:46.595360 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8d1ca3d1-63a6-4f32-aa27-596c520623fe tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:46.615187 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8d1ca3d1-63a6-4f32-aa27-596c520623fe tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1239 microversion: 2.1 time: 0.623894 Jul 18 10:47:46.618866 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 14/28] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:45 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1239 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:46.622568 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-ccc3957b-0c00-4a93-b230-7cefc34705ed tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:46.623384 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-ccc3957b-0c00-4a93-b230-7cefc34705ed tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:46.659768 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ccc3957b-0c00-4a93-b230-7cefc34705ed tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:46.659768 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ccc3957b-0c00-4a93-b230-7cefc34705ed tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:46.659768 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ccc3957b-0c00-4a93-b230-7cefc34705ed tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:46.660124 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ccc3957b-0c00-4a93-b230-7cefc34705ed tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:46.733621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-cf9484ef-6378-4def-a35e-53c5bc9f5dee tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:46.777276 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-cf9484ef-6378-4def-a35e-53c5bc9f5dee tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:46.781740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-cf9484ef-6378-4def-a35e-53c5bc9f5dee tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:46.787695 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-cf9484ef-6378-4def-a35e-53c5bc9f5dee tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1334 microversion: 2.20 time: 0.802530 Jul 18 10:47:46.792768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 15/29] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:45 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1334 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:47:46.997937 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-34274b1f-ab8d-47f6-b7a3-05c7ab80e420 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:46.999107 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-34274b1f-ab8d-47f6-b7a3-05c7ab80e420 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:47.020494 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ccc3957b-0c00-4a93-b230-7cefc34705ed tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:47.024024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=47 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:47.042106 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-ccc3957b-0c00-4a93-b230-7cefc34705ed tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1314 microversion: 2.1 time: 0.422314 Jul 18 10:47:47.053174 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-34274b1f-ab8d-47f6-b7a3-05c7ab80e420 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:47.053174 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-34274b1f-ab8d-47f6-b7a3-05c7ab80e420 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:47.053548 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 15/30] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:46 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:47.053646 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-34274b1f-ab8d-47f6-b7a3-05c7ab80e420 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:47.053646 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-34274b1f-ab8d-47f6-b7a3-05c7ab80e420 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:47.066375 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-18ad0ee0-e5b1-4af4-be45-700eb9818466 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:47.068843 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-18ad0ee0-e5b1-4af4-be45-700eb9818466 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:47.091780 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:47.094231 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18ad0ee0-e5b1-4af4-be45-700eb9818466 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:47.100009 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18ad0ee0-e5b1-4af4-be45-700eb9818466 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:47.103274 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18ad0ee0-e5b1-4af4-be45-700eb9818466 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:47.104087 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18ad0ee0-e5b1-4af4-be45-700eb9818466 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:47.746166 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-34274b1f-ab8d-47f6-b7a3-05c7ab80e420 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:47.778646 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-34274b1f-ab8d-47f6-b7a3-05c7ab80e420 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1321 microversion: 2.1 time: 0.785094 Jul 18 10:47:47.784893 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 16/31] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:46 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1321 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:47.797636 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-300bbf92-1d43-4a63-949b-c6165f58ab5e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:47.806086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-300bbf92-1d43-4a63-949b-c6165f58ab5e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:47.808734 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-300bbf92-1d43-4a63-949b-c6165f58ab5e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:47.809548 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-300bbf92-1d43-4a63-949b-c6165f58ab5e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:47.811954 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-300bbf92-1d43-4a63-949b-c6165f58ab5e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:47.812648 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-300bbf92-1d43-4a63-949b-c6165f58ab5e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:48.165249 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-300bbf92-1d43-4a63-949b-c6165f58ab5e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:48.180668 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-300bbf92-1d43-4a63-949b-c6165f58ab5e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1243 microversion: 2.1 time: 0.393204 Jul 18 10:47:48.181725 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 17/32] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:47 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1243 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:48.204949 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-18ad0ee0-e5b1-4af4-be45-700eb9818466 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:48.215432 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-17ad3aec-470a-4bd0-8ffa-32a58922b46c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:48.221073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-17ad3aec-470a-4bd0-8ffa-32a58922b46c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:48.224217 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-18ad0ee0-e5b1-4af4-be45-700eb9818466 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1363 microversion: 2.1 time: 1.168946 Jul 18 10:47:48.236203 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 16/33] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:47 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1363 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:48.250628 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-17ad3aec-470a-4bd0-8ffa-32a58922b46c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:48.258603 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-17ad3aec-470a-4bd0-8ffa-32a58922b46c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:48.259987 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5e3f2e82-6034-4c35-89d7-08e64fee6525 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:48.261568 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-17ad3aec-470a-4bd0-8ffa-32a58922b46c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:48.264679 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5e3f2e82-6034-4c35-89d7-08e64fee6525 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:48.266101 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-17ad3aec-470a-4bd0-8ffa-32a58922b46c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:48.333209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5e3f2e82-6034-4c35-89d7-08e64fee6525 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:48.340048 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5e3f2e82-6034-4c35-89d7-08e64fee6525 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:48.349103 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5e3f2e82-6034-4c35-89d7-08e64fee6525 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:48.357534 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5e3f2e82-6034-4c35-89d7-08e64fee6525 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:49.876085 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-17ad3aec-470a-4bd0-8ffa-32a58922b46c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:49.905757 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=65 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:49.923046 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-17ad3aec-470a-4bd0-8ffa-32a58922b46c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:49.927760 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-17ad3aec-470a-4bd0-8ffa-32a58922b46c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:49.936707 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-17ad3aec-470a-4bd0-8ffa-32a58922b46c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1340 microversion: 2.20 time: 1.750247 Jul 18 10:47:49.948486 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 18/34] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:48 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1340 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:47:49.972583 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-1ca0a21f-1f6c-4487-b57b-a9d6f139fbad tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:49.979760 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-1ca0a21f-1f6c-4487-b57b-a9d6f139fbad tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:50.001985 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1ca0a21f-1f6c-4487-b57b-a9d6f139fbad tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:50.002910 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1ca0a21f-1f6c-4487-b57b-a9d6f139fbad tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:50.005739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1ca0a21f-1f6c-4487-b57b-a9d6f139fbad tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:50.005739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1ca0a21f-1f6c-4487-b57b-a9d6f139fbad tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:50.223054 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5e3f2e82-6034-4c35-89d7-08e64fee6525 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:50.295899 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5e3f2e82-6034-4c35-89d7-08e64fee6525 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1314 microversion: 2.1 time: 2.041337 Jul 18 10:47:50.296830 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 17/35] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:48 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1314 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:51.042511 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-23298445-cebe-4a48-aa78-4445e044f21e req-a3434b79-247b-43d1-9ff1-0c3a55d4fd40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f96ccdd-67b5-403c-a3b9-8022e271690c", "tag": "820fb007-4789-49d7-84d1-ecf34d4d542f"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:51.060265 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-23298445-cebe-4a48-aa78-4445e044f21e req-a3434b79-247b-43d1-9ff1-0c3a55d4fd40 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:51.060954 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-23298445-cebe-4a48-aa78-4445e044f21e req-a3434b79-247b-43d1-9ff1-0c3a55d4fd40 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:51.169087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-1ca0a21f-1f6c-4487-b57b-a9d6f139fbad tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:51.182183 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-1ca0a21f-1f6c-4487-b57b-a9d6f139fbad tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1321 microversion: 2.1 time: 1.226696 Jul 18 10:47:51.192146 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-23298445-cebe-4a48-aa78-4445e044f21e req-a3434b79-247b-43d1-9ff1-0c3a55d4fd40 service nova] Creating event network-changed:820fb007-4789-49d7-84d1-ecf34d4d542f for instance 0f96ccdd-67b5-403c-a3b9-8022e271690c on hv-cinder-84949 Jul 18 10:47:51.192860 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 19/36] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:49 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1321 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:51.195835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-23298445-cebe-4a48-aa78-4445e044f21e req-a3434b79-247b-43d1-9ff1-0c3a55d4fd40 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125005) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 10:47:51.197484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d0e10d07-798a-4fb6-b6de-127c5c812c08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:51.198031 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d0e10d07-798a-4fb6-b6de-127c5c812c08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:51.198290 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-83b6236f-0c7f-4960-9cf7-1292ccab5836 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:51.199179 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d0e10d07-798a-4fb6-b6de-127c5c812c08 None None] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:51.224642 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d0e10d07-798a-4fb6-b6de-127c5c812c08 None None] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:51.224642 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=2 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:51.226114 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-83b6236f-0c7f-4960-9cf7-1292ccab5836 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:51.226194 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.compute.rpcapi [None req-d0e10d07-798a-4fb6-b6de-127c5c812c08 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 10:47:51.226259 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-83b6236f-0c7f-4960-9cf7-1292ccab5836 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:51.226259 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-83b6236f-0c7f-4960-9cf7-1292ccab5836 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:51.228883 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-83b6236f-0c7f-4960-9cf7-1292ccab5836 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:51.229779 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-83b6236f-0c7f-4960-9cf7-1292ccab5836 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:51.245509 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d0e10d07-798a-4fb6-b6de-127c5c812c08 None None] Releasing lock "compute-rpcapi-router" {{(pid=125005) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 10:47:51.303134 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d0e10d07-798a-4fb6-b6de-127c5c812c08 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.985069 Jul 18 10:47:51.303709 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 18/37] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:51.346345 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-562f5ad3-9042-4115-89ae-7fc1c0429712 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:51.349153 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-562f5ad3-9042-4115-89ae-7fc1c0429712 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:51.359473 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-562f5ad3-9042-4115-89ae-7fc1c0429712 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:51.360318 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-562f5ad3-9042-4115-89ae-7fc1c0429712 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:51.375754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-562f5ad3-9042-4115-89ae-7fc1c0429712 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:51.376921 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-562f5ad3-9042-4115-89ae-7fc1c0429712 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:51.454521 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-83b6236f-0c7f-4960-9cf7-1292ccab5836 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:51.469198 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-83b6236f-0c7f-4960-9cf7-1292ccab5836 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1309 microversion: 2.1 time: 0.274645 Jul 18 10:47:51.470844 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 20/38] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:51 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1309 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:51.484769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0734076c-766a-40ce-b126-1093c1e48322 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:51.486960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-0734076c-766a-40ce-b126-1093c1e48322 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:51.557906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0734076c-766a-40ce-b126-1093c1e48322 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:51.559389 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0734076c-766a-40ce-b126-1093c1e48322 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:51.562784 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0734076c-766a-40ce-b126-1093c1e48322 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:51.567047 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0734076c-766a-40ce-b126-1093c1e48322 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:52.186186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-0734076c-766a-40ce-b126-1093c1e48322 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:52.205334 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-0734076c-766a-40ce-b126-1093c1e48322 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:52.214816 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-0734076c-766a-40ce-b126-1093c1e48322 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:52.216386 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-0734076c-766a-40ce-b126-1093c1e48322 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1340 microversion: 2.20 time: 0.742083 Jul 18 10:47:52.221382 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 21/39] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:51 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1340 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:47:52.254872 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2df57a1f-a780-4afc-9ee5-f6b4acda5082 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:52.255357 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2df57a1f-a780-4afc-9ee5-f6b4acda5082 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:52.272823 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2df57a1f-a780-4afc-9ee5-f6b4acda5082 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:52.274062 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2df57a1f-a780-4afc-9ee5-f6b4acda5082 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:52.275577 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2df57a1f-a780-4afc-9ee5-f6b4acda5082 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:52.276460 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2df57a1f-a780-4afc-9ee5-f6b4acda5082 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:53.257276 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-562f5ad3-9042-4115-89ae-7fc1c0429712 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:53.282599 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-562f5ad3-9042-4115-89ae-7fc1c0429712 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1363 microversion: 2.1 time: 1.969342 Jul 18 10:47:53.287074 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 19/40] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:51 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1363 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:53.303271 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-46779cd9-1cd7-49e8-a951-ac1789e5408f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:53.303902 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-46779cd9-1cd7-49e8-a951-ac1789e5408f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:53.314258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-46779cd9-1cd7-49e8-a951-ac1789e5408f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:53.314758 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-46779cd9-1cd7-49e8-a951-ac1789e5408f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:53.322389 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2df57a1f-a780-4afc-9ee5-f6b4acda5082 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:53.333593 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2df57a1f-a780-4afc-9ee5-f6b4acda5082 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1314 microversion: 2.1 time: 1.110398 Jul 18 10:47:53.334237 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 22/41] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:52 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1314 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:53.347584 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-46779cd9-1cd7-49e8-a951-ac1789e5408f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:53.348189 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-46779cd9-1cd7-49e8-a951-ac1789e5408f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:53.556629 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-64fa8532-de7f-47dc-98ff-c94077dd1130 req-370ce107-aabb-4712-9d91-a588db25e6fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "448b223d-269c-44ab-9fb8-01e1f863ee49", "tag": "a660016a-47a5-4610-b64d-eed8b0819a10"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:53.598793 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-64fa8532-de7f-47dc-98ff-c94077dd1130 req-370ce107-aabb-4712-9d91-a588db25e6fb service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:53.599270 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-64fa8532-de7f-47dc-98ff-c94077dd1130 req-370ce107-aabb-4712-9d91-a588db25e6fb service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:53.639946 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-64fa8532-de7f-47dc-98ff-c94077dd1130 req-370ce107-aabb-4712-9d91-a588db25e6fb service nova] Creating event network-changed:a660016a-47a5-4610-b64d-eed8b0819a10 for instance 448b223d-269c-44ab-9fb8-01e1f863ee49 on hv-cinder-84949 Jul 18 10:47:53.640411 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-64fa8532-de7f-47dc-98ff-c94077dd1130 req-370ce107-aabb-4712-9d91-a588db25e6fb service nova] Acquired lock "compute-rpcapi-router" {{(pid=125007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 10:47:53.641953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cc12cd27-c647-4e19-9a1e-7941ed5299cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:53.642462 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cc12cd27-c647-4e19-9a1e-7941ed5299cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:53.647041 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cc12cd27-c647-4e19-9a1e-7941ed5299cc None None] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:53.647529 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cc12cd27-c647-4e19-9a1e-7941ed5299cc None None] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:53.658306 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.compute.rpcapi [None req-cc12cd27-c647-4e19-9a1e-7941ed5299cc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 10:47:53.660105 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cc12cd27-c647-4e19-9a1e-7941ed5299cc None None] Releasing lock "compute-rpcapi-router" {{(pid=125007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 10:47:53.707949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-cc12cd27-c647-4e19-9a1e-7941ed5299cc None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.365953 Jul 18 10:47:53.708863 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 23/42] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:53.723431 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4de35e9d-286b-4bd1-98ac-a3ca91a7c6d4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:53.731409 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-4de35e9d-286b-4bd1-98ac-a3ca91a7c6d4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:53.747579 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4de35e9d-286b-4bd1-98ac-a3ca91a7c6d4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:53.753869 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4de35e9d-286b-4bd1-98ac-a3ca91a7c6d4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:53.756105 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4de35e9d-286b-4bd1-98ac-a3ca91a7c6d4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:53.756815 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4de35e9d-286b-4bd1-98ac-a3ca91a7c6d4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:53.757741 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=34 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:53.960045 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-4de35e9d-286b-4bd1-98ac-a3ca91a7c6d4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:54.066987 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4de35e9d-286b-4bd1-98ac-a3ca91a7c6d4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1297 microversion: 2.1 time: 0.347849 Jul 18 10:47:54.072387 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-46779cd9-1cd7-49e8-a951-ac1789e5408f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:54.072741 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 24/43] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:53 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1297 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:54.109903 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9c928bfb-feab-4da9-9895-0b7b2d929a03 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:54.112383 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9c928bfb-feab-4da9-9895-0b7b2d929a03 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:54.134922 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9c928bfb-feab-4da9-9895-0b7b2d929a03 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:54.136386 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9c928bfb-feab-4da9-9895-0b7b2d929a03 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:54.137155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-46779cd9-1cd7-49e8-a951-ac1789e5408f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1321 microversion: 2.1 time: 0.848403 Jul 18 10:47:54.138326 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 20/44] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:53 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1321 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:54.146654 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9c928bfb-feab-4da9-9895-0b7b2d929a03 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:54.147767 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9c928bfb-feab-4da9-9895-0b7b2d929a03 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:54.189627 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-fb14c7d6-79e5-494a-a7da-551bea3124f6 req-3e34cc67-92ab-4ad5-be2a-4542dab74550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4728713a-e4cd-4e09-b104-7a57de4f2242", "tag": "a2d9794f-2a33-4778-92a2-20c4de5af12b"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:54.215863 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-fb14c7d6-79e5-494a-a7da-551bea3124f6 req-3e34cc67-92ab-4ad5-be2a-4542dab74550 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:54.216490 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-fb14c7d6-79e5-494a-a7da-551bea3124f6 req-3e34cc67-92ab-4ad5-be2a-4542dab74550 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:54.263194 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-fb14c7d6-79e5-494a-a7da-551bea3124f6 req-3e34cc67-92ab-4ad5-be2a-4542dab74550 service nova] Creating event network-changed:a2d9794f-2a33-4778-92a2-20c4de5af12b for instance 4728713a-e4cd-4e09-b104-7a57de4f2242 on hv-cinder-84949 Jul 18 10:47:54.279219 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-fb14c7d6-79e5-494a-a7da-551bea3124f6 req-3e34cc67-92ab-4ad5-be2a-4542dab74550 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138923 Jul 18 10:47:54.284849 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 21/45] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:54.318807 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-515d7fc6-a314-4574-b965-42543a36f8c4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:54.320845 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-515d7fc6-a314-4574-b965-42543a36f8c4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:54.331798 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-515d7fc6-a314-4574-b965-42543a36f8c4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:54.348576 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-515d7fc6-a314-4574-b965-42543a36f8c4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:54.352115 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-515d7fc6-a314-4574-b965-42543a36f8c4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:54.356680 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-515d7fc6-a314-4574-b965-42543a36f8c4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:54.735705 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9c928bfb-feab-4da9-9895-0b7b2d929a03 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:54.735705 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9c928bfb-feab-4da9-9895-0b7b2d929a03 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:54.736673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9c928bfb-feab-4da9-9895-0b7b2d929a03 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:54.736673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9c928bfb-feab-4da9-9895-0b7b2d929a03 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1340 microversion: 2.20 time: 0.648238 Jul 18 10:47:54.736673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 25/46] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:54 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1340 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:47:54.736673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5106b6df-4b0f-4624-bfc4-51f647b239a4 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:54.737484 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-5106b6df-4b0f-4624-bfc4-51f647b239a4 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:54.761229 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5106b6df-4b0f-4624-bfc4-51f647b239a4 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:54.761867 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5106b6df-4b0f-4624-bfc4-51f647b239a4 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:54.771095 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5106b6df-4b0f-4624-bfc4-51f647b239a4 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:54.771095 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5106b6df-4b0f-4624-bfc4-51f647b239a4 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:55.046305 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-515d7fc6-a314-4574-b965-42543a36f8c4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:55.059661 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-515d7fc6-a314-4574-b965-42543a36f8c4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1363 microversion: 2.1 time: 0.756153 Jul 18 10:47:55.073810 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 22/47] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:54 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1363 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:55.122850 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-0c38db8d-d351-4c1f-8346-e12298ab7bcf tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:55.124328 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-0c38db8d-d351-4c1f-8346-e12298ab7bcf tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:55.139467 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0c38db8d-d351-4c1f-8346-e12298ab7bcf tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:55.140768 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0c38db8d-d351-4c1f-8346-e12298ab7bcf tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:55.142258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0c38db8d-d351-4c1f-8346-e12298ab7bcf tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:55.143663 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0c38db8d-d351-4c1f-8346-e12298ab7bcf tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:55.409348 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-5106b6df-4b0f-4624-bfc4-51f647b239a4 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:55.430416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5106b6df-4b0f-4624-bfc4-51f647b239a4 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1314 microversion: 2.1 time: 0.696321 Jul 18 10:47:55.430416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 26/48] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:54 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:55.430416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-c83f6b98-4c6d-47ff-949a-6fe8ccaf9853 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:55.431232 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-c83f6b98-4c6d-47ff-949a-6fe8ccaf9853 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:55.442149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c83f6b98-4c6d-47ff-949a-6fe8ccaf9853 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:55.445691 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c83f6b98-4c6d-47ff-949a-6fe8ccaf9853 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:55.448012 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c83f6b98-4c6d-47ff-949a-6fe8ccaf9853 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:55.448705 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c83f6b98-4c6d-47ff-949a-6fe8ccaf9853 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:55.527216 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0c38db8d-d351-4c1f-8346-e12298ab7bcf tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:55.537574 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-0c38db8d-d351-4c1f-8346-e12298ab7bcf tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1365 microversion: 2.1 time: 0.421456 Jul 18 10:47:55.539043 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 23/49] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:55 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1365 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:55.686904 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c83f6b98-4c6d-47ff-949a-6fe8ccaf9853 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:55.704455 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-c83f6b98-4c6d-47ff-949a-6fe8ccaf9853 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1321 microversion: 2.1 time: 0.279738 Jul 18 10:47:55.706292 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 27/50] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:55 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:55.729410 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-d8f07b03-c2d2-4e61-929d-fefb7fda71ee req-40895956-f3d4-4143-ae3f-75e884acc5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1449a0db-3f38-4456-8a45-7b4a40105095", "tag": "fc6df403-f5e5-427c-868d-17653a05457d"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:55.738837 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-d8f07b03-c2d2-4e61-929d-fefb7fda71ee req-40895956-f3d4-4143-ae3f-75e884acc5b6 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:55.740911 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-d8f07b03-c2d2-4e61-929d-fefb7fda71ee req-40895956-f3d4-4143-ae3f-75e884acc5b6 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:55.751212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a49c37ac-aa64-46eb-8318-821b7af1f517 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:55.754335 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a49c37ac-aa64-46eb-8318-821b7af1f517 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:55.754843 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-d8f07b03-c2d2-4e61-929d-fefb7fda71ee req-40895956-f3d4-4143-ae3f-75e884acc5b6 service nova] Creating event network-changed:fc6df403-f5e5-427c-868d-17653a05457d for instance 1449a0db-3f38-4456-8a45-7b4a40105095 on hv-cinder-84949 Jul 18 10:47:55.760581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-d8f07b03-c2d2-4e61-929d-fefb7fda71ee req-40895956-f3d4-4143-ae3f-75e884acc5b6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035856 Jul 18 10:47:55.761508 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 24/51] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:47:55.767641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a49c37ac-aa64-46eb-8318-821b7af1f517 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:55.769002 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a49c37ac-aa64-46eb-8318-821b7af1f517 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:55.770359 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a49c37ac-aa64-46eb-8318-821b7af1f517 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:55.771285 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a49c37ac-aa64-46eb-8318-821b7af1f517 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:55.975534 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a49c37ac-aa64-46eb-8318-821b7af1f517 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:55.984373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a49c37ac-aa64-46eb-8318-821b7af1f517 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:55.985920 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a49c37ac-aa64-46eb-8318-821b7af1f517 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:55.987589 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a49c37ac-aa64-46eb-8318-821b7af1f517 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1407 microversion: 2.20 time: 0.245365 Jul 18 10:47:55.988333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 28/52] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:55 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:47:56.078909 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-31d29002-08a0-4e0b-b19a-ba6b2d703ae5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:56.079644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-31d29002-08a0-4e0b-b19a-ba6b2d703ae5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:56.087543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-31d29002-08a0-4e0b-b19a-ba6b2d703ae5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:56.087993 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-31d29002-08a0-4e0b-b19a-ba6b2d703ae5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:56.088819 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-31d29002-08a0-4e0b-b19a-ba6b2d703ae5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:56.089258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-31d29002-08a0-4e0b-b19a-ba6b2d703ae5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:56.301404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-31d29002-08a0-4e0b-b19a-ba6b2d703ae5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:56.318897 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-31d29002-08a0-4e0b-b19a-ba6b2d703ae5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1363 microversion: 2.1 time: 0.243706 Jul 18 10:47:56.319800 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 25/53] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:56 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:56.443377 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-66522745-4453-4154-9c2c-8f25f4afbff2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:56.444512 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-66522745-4453-4154-9c2c-8f25f4afbff2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:56.453370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-66522745-4453-4154-9c2c-8f25f4afbff2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:56.457790 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-66522745-4453-4154-9c2c-8f25f4afbff2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:56.457790 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-66522745-4453-4154-9c2c-8f25f4afbff2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:56.457790 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-66522745-4453-4154-9c2c-8f25f4afbff2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:56.547712 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-39f3ca7e-c40c-4907-a915-b6515d6d5417 req-7ec02985-e5a1-4af3-bfa1-b728b2ad0bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eadfa860-196c-4946-85a4-a9a2aed7c1b7", "tag": "dce7face-5f9b-40f7-8b3c-e6b845457a5e"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:56.565955 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-39f3ca7e-c40c-4907-a915-b6515d6d5417 req-7ec02985-e5a1-4af3-bfa1-b728b2ad0bac service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:56.566690 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-39f3ca7e-c40c-4907-a915-b6515d6d5417 req-7ec02985-e5a1-4af3-bfa1-b728b2ad0bac service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:56.581939 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-39f3ca7e-c40c-4907-a915-b6515d6d5417 req-7ec02985-e5a1-4af3-bfa1-b728b2ad0bac service nova] Creating event network-changed:dce7face-5f9b-40f7-8b3c-e6b845457a5e for instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 on hv-cinder-84949 Jul 18 10:47:56.597037 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-39f3ca7e-c40c-4907-a915-b6515d6d5417 req-7ec02985-e5a1-4af3-bfa1-b728b2ad0bac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045179 Jul 18 10:47:56.597037 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 26/54] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:56.604151 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a20f66c2-867f-4c26-b9f9-64f4f6aad82e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:56.604950 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a20f66c2-867f-4c26-b9f9-64f4f6aad82e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:56.607796 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=8 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:56.614741 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a20f66c2-867f-4c26-b9f9-64f4f6aad82e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:56.615536 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a20f66c2-867f-4c26-b9f9-64f4f6aad82e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:56.616543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a20f66c2-867f-4c26-b9f9-64f4f6aad82e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:56.617247 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a20f66c2-867f-4c26-b9f9-64f4f6aad82e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:56.681186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-66522745-4453-4154-9c2c-8f25f4afbff2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:56.690890 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-66522745-4453-4154-9c2c-8f25f4afbff2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1314 microversion: 2.1 time: 0.253154 Jul 18 10:47:56.691601 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 29/55] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:56 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:56.725687 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8dd94378-e8f2-4304-9439-97d2c416df68 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:56.726313 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-8dd94378-e8f2-4304-9439-97d2c416df68 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:56.739129 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8dd94378-e8f2-4304-9439-97d2c416df68 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:56.740268 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8dd94378-e8f2-4304-9439-97d2c416df68 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:56.741439 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8dd94378-e8f2-4304-9439-97d2c416df68 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:56.742397 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8dd94378-e8f2-4304-9439-97d2c416df68 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:56.837665 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a20f66c2-867f-4c26-b9f9-64f4f6aad82e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:56.850242 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a20f66c2-867f-4c26-b9f9-64f4f6aad82e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1365 microversion: 2.1 time: 0.258463 Jul 18 10:47:56.852167 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 27/56] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:56 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:56.939451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-8dd94378-e8f2-4304-9439-97d2c416df68 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:56.948696 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-8dd94378-e8f2-4304-9439-97d2c416df68 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1321 microversion: 2.1 time: 0.228648 Jul 18 10:47:56.958620 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 30/57] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:56 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:57.015797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-4ceed95b-03d8-4736-a58b-aab430157199 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:57.016504 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-4ceed95b-03d8-4736-a58b-aab430157199 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:57.023045 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4ceed95b-03d8-4736-a58b-aab430157199 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:57.023653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4ceed95b-03d8-4736-a58b-aab430157199 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:57.024411 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4ceed95b-03d8-4736-a58b-aab430157199 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:57.025889 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4ceed95b-03d8-4736-a58b-aab430157199 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:57.172285 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4ceed95b-03d8-4736-a58b-aab430157199 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:57.182443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4ceed95b-03d8-4736-a58b-aab430157199 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:57.183944 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4ceed95b-03d8-4736-a58b-aab430157199 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:57.185230 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-4ceed95b-03d8-4736-a58b-aab430157199 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1407 microversion: 2.20 time: 0.175229 Jul 18 10:47:57.185925 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 28/58] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:57 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:47:57.338529 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-33171d89-ea5a-4028-9553-af01ed9dfaea tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:57.339145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-33171d89-ea5a-4028-9553-af01ed9dfaea tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:57.345397 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-33171d89-ea5a-4028-9553-af01ed9dfaea tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:57.346920 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-33171d89-ea5a-4028-9553-af01ed9dfaea tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:57.347859 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-33171d89-ea5a-4028-9553-af01ed9dfaea tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:57.348294 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-33171d89-ea5a-4028-9553-af01ed9dfaea tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:57.580317 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-33171d89-ea5a-4028-9553-af01ed9dfaea tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:57.600450 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-33171d89-ea5a-4028-9553-af01ed9dfaea tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1363 microversion: 2.1 time: 0.256200 Jul 18 10:47:57.600450 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 31/59] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:57 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:57.708739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-da61cd67-2dc4-44af-b9ec-9c1f66084fbc tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:57.709374 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-da61cd67-2dc4-44af-b9ec-9c1f66084fbc tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:57.716596 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-da61cd67-2dc4-44af-b9ec-9c1f66084fbc tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:57.717325 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-da61cd67-2dc4-44af-b9ec-9c1f66084fbc tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:57.718250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-da61cd67-2dc4-44af-b9ec-9c1f66084fbc tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:57.718821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-da61cd67-2dc4-44af-b9ec-9c1f66084fbc tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:57.871646 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-215c17da-48bb-4044-a3e9-9030d6d68436 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:57.872362 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-215c17da-48bb-4044-a3e9-9030d6d68436 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:57.879894 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-215c17da-48bb-4044-a3e9-9030d6d68436 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:57.880436 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-215c17da-48bb-4044-a3e9-9030d6d68436 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:57.881355 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-215c17da-48bb-4044-a3e9-9030d6d68436 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:57.881918 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-215c17da-48bb-4044-a3e9-9030d6d68436 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:57.998979 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-da61cd67-2dc4-44af-b9ec-9c1f66084fbc tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:58.008196 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-da61cd67-2dc4-44af-b9ec-9c1f66084fbc tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1314 microversion: 2.1 time: 0.304398 Jul 18 10:47:58.009256 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 29/60] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:57 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:58.014333 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b10df52c-d744-45a6-944f-25aafe1509cd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:58.015152 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b10df52c-d744-45a6-944f-25aafe1509cd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:58.021875 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b10df52c-d744-45a6-944f-25aafe1509cd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:58.022352 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b10df52c-d744-45a6-944f-25aafe1509cd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:58.023290 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b10df52c-d744-45a6-944f-25aafe1509cd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:58.023900 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b10df52c-d744-45a6-944f-25aafe1509cd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:58.178471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-215c17da-48bb-4044-a3e9-9030d6d68436 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:58.193239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-215c17da-48bb-4044-a3e9-9030d6d68436 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1365 microversion: 2.1 time: 0.325486 Jul 18 10:47:58.194273 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 32/61] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:57 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1365 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:58.204955 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-421a302a-511a-4db9-960b-fb5805d93ea9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:58.206407 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-421a302a-511a-4db9-960b-fb5805d93ea9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:58.213317 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-421a302a-511a-4db9-960b-fb5805d93ea9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:58.213941 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-421a302a-511a-4db9-960b-fb5805d93ea9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:58.220636 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-421a302a-511a-4db9-960b-fb5805d93ea9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:58.220636 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-421a302a-511a-4db9-960b-fb5805d93ea9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:58.246535 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-b10df52c-d744-45a6-944f-25aafe1509cd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:58.255868 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b10df52c-d744-45a6-944f-25aafe1509cd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1321 microversion: 2.1 time: 0.245380 Jul 18 10:47:58.256473 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 30/62] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:58 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:58.561362 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-421a302a-511a-4db9-960b-fb5805d93ea9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:58.576251 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-421a302a-511a-4db9-960b-fb5805d93ea9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:58.581992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-421a302a-511a-4db9-960b-fb5805d93ea9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:58.594330 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-421a302a-511a-4db9-960b-fb5805d93ea9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1407 microversion: 2.20 time: 0.394396 Jul 18 10:47:58.595186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 33/63] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:58 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1407 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:47:58.616981 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-89eb4421-56e2-4c1b-ba64-be2fe3e100c5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:58.617814 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-89eb4421-56e2-4c1b-ba64-be2fe3e100c5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:58.631902 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89eb4421-56e2-4c1b-ba64-be2fe3e100c5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:58.632461 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89eb4421-56e2-4c1b-ba64-be2fe3e100c5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:58.638513 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89eb4421-56e2-4c1b-ba64-be2fe3e100c5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:58.639371 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89eb4421-56e2-4c1b-ba64-be2fe3e100c5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:58.946413 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-89eb4421-56e2-4c1b-ba64-be2fe3e100c5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:58.965121 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-139d423d-cc9b-416c-a484-7b54033b1f40 req-5c284444-c00d-4556-8812-c73cde9a5a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d05192-b009-41ab-861b-b66d0352d41e", "tag": "abd1fe5c-3f12-4f5e-a659-6f5e05dab0ae"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:58.977049 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-89eb4421-56e2-4c1b-ba64-be2fe3e100c5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1363 microversion: 2.1 time: 0.362512 Jul 18 10:47:58.979129 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 31/64] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:58 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1363 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:58.984304 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-139d423d-cc9b-416c-a484-7b54033b1f40 req-5c284444-c00d-4556-8812-c73cde9a5a26 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:58.985456 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-139d423d-cc9b-416c-a484-7b54033b1f40 req-5c284444-c00d-4556-8812-c73cde9a5a26 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:59.002254 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-139d423d-cc9b-416c-a484-7b54033b1f40 req-5c284444-c00d-4556-8812-c73cde9a5a26 service nova] Creating event network-changed:abd1fe5c-3f12-4f5e-a659-6f5e05dab0ae for instance 14d05192-b009-41ab-861b-b66d0352d41e on hv-cinder-84949 Jul 18 10:47:59.010966 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-139d423d-cc9b-416c-a484-7b54033b1f40 req-5c284444-c00d-4556-8812-c73cde9a5a26 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052824 Jul 18 10:47:59.010966 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 34/65] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:59.025985 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-1a469798-3a22-47ba-af36-bafea347a1aa tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:59.026803 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-1a469798-3a22-47ba-af36-bafea347a1aa tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:59.036148 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1a469798-3a22-47ba-af36-bafea347a1aa tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:59.036892 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1a469798-3a22-47ba-af36-bafea347a1aa tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:59.038077 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1a469798-3a22-47ba-af36-bafea347a1aa tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:59.038654 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1a469798-3a22-47ba-af36-bafea347a1aa tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:59.217870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ed3a1156-8d25-4a22-91bb-c0582206809c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:59.238956 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ed3a1156-8d25-4a22-91bb-c0582206809c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:59.290855 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ed3a1156-8d25-4a22-91bb-c0582206809c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:59.292299 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ed3a1156-8d25-4a22-91bb-c0582206809c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:59.294004 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ed3a1156-8d25-4a22-91bb-c0582206809c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:59.294785 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ed3a1156-8d25-4a22-91bb-c0582206809c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:59.338759 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-1a469798-3a22-47ba-af36-bafea347a1aa tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:59.349464 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-1a469798-3a22-47ba-af36-bafea347a1aa tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1314 microversion: 2.1 time: 0.327374 Jul 18 10:47:59.359397 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 32/66] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:59 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:59.365331 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3e4b1d0e-40ed-4826-9e3b-ce67fbcb6a44 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:59.366055 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3e4b1d0e-40ed-4826-9e3b-ce67fbcb6a44 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:59.372980 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3e4b1d0e-40ed-4826-9e3b-ce67fbcb6a44 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:59.373536 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3e4b1d0e-40ed-4826-9e3b-ce67fbcb6a44 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:59.374363 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3e4b1d0e-40ed-4826-9e3b-ce67fbcb6a44 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:59.375868 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3e4b1d0e-40ed-4826-9e3b-ce67fbcb6a44 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:00.037391 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ed3a1156-8d25-4a22-91bb-c0582206809c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:00.053843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ed3a1156-8d25-4a22-91bb-c0582206809c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1365 microversion: 2.1 time: 0.844438 Jul 18 10:48:00.066763 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 35/67] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:59 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1365 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:00.073170 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ef16908a-52ec-4537-9c1b-334758647657 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:00.074001 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ef16908a-52ec-4537-9c1b-334758647657 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:00.074264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3e4b1d0e-40ed-4826-9e3b-ce67fbcb6a44 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:00.085681 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ef16908a-52ec-4537-9c1b-334758647657 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:00.088116 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ef16908a-52ec-4537-9c1b-334758647657 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:00.089359 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ef16908a-52ec-4537-9c1b-334758647657 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:00.090310 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3e4b1d0e-40ed-4826-9e3b-ce67fbcb6a44 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1321 microversion: 2.1 time: 0.733342 Jul 18 10:48:00.090785 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ef16908a-52ec-4537-9c1b-334758647657 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:00.091666 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 33/68] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:59 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1321 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:00.100070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c97df7f2-8cd2-484b-8798-dca42070f332 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:00.100687 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c97df7f2-8cd2-484b-8798-dca42070f332 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:00.109423 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c97df7f2-8cd2-484b-8798-dca42070f332 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:00.109917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c97df7f2-8cd2-484b-8798-dca42070f332 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:00.110703 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c97df7f2-8cd2-484b-8798-dca42070f332 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:00.111137 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c97df7f2-8cd2-484b-8798-dca42070f332 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:00.124544 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=100 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:00.458641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ef16908a-52ec-4537-9c1b-334758647657 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:00.469773 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ef16908a-52ec-4537-9c1b-334758647657 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:00.472328 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ef16908a-52ec-4537-9c1b-334758647657 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:00.473673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ef16908a-52ec-4537-9c1b-334758647657 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1407 microversion: 2.20 time: 0.405678 Jul 18 10:48:00.474859 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 36/69] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:00 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:00.479563 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ec2702a4-e042-4704-8a2a-5a2a8a9c6fd2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:00.480531 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ec2702a4-e042-4704-8a2a-5a2a8a9c6fd2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:00.492459 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ec2702a4-e042-4704-8a2a-5a2a8a9c6fd2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:00.493357 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ec2702a4-e042-4704-8a2a-5a2a8a9c6fd2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:00.494663 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ec2702a4-e042-4704-8a2a-5a2a8a9c6fd2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:00.495262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ec2702a4-e042-4704-8a2a-5a2a8a9c6fd2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:00.519459 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c97df7f2-8cd2-484b-8798-dca42070f332 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:00.526237 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=100 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:00.532278 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c97df7f2-8cd2-484b-8798-dca42070f332 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1363 microversion: 2.1 time: 0.438320 Jul 18 10:48:00.535498 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 34/70] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:00 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1363 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:00.793616 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ec2702a4-e042-4704-8a2a-5a2a8a9c6fd2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:00.802040 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ec2702a4-e042-4704-8a2a-5a2a8a9c6fd2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1314 microversion: 2.1 time: 0.325924 Jul 18 10:48:00.802897 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 37/71] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:00 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:01.072483 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-62da9fe0-00a9-4b00-bf1a-0510d438c251 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:01.073316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-62da9fe0-00a9-4b00-bf1a-0510d438c251 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:01.079753 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-62da9fe0-00a9-4b00-bf1a-0510d438c251 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:01.081838 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-62da9fe0-00a9-4b00-bf1a-0510d438c251 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:01.082650 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-62da9fe0-00a9-4b00-bf1a-0510d438c251 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:01.083679 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-62da9fe0-00a9-4b00-bf1a-0510d438c251 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:01.108914 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-95c758f4-19c3-44cb-80c6-585c9a1feccb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:01.109525 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-95c758f4-19c3-44cb-80c6-585c9a1feccb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:01.116439 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-95c758f4-19c3-44cb-80c6-585c9a1feccb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:01.116911 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-95c758f4-19c3-44cb-80c6-585c9a1feccb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:01.117680 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-95c758f4-19c3-44cb-80c6-585c9a1feccb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:01.118112 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-95c758f4-19c3-44cb-80c6-585c9a1feccb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:01.290632 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-62da9fe0-00a9-4b00-bf1a-0510d438c251 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:01.300692 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-62da9fe0-00a9-4b00-bf1a-0510d438c251 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1365 microversion: 2.1 time: 0.232459 Jul 18 10:48:01.303671 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-95c758f4-19c3-44cb-80c6-585c9a1feccb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:01.311581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 35/72] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:01 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:01.318231 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-95c758f4-19c3-44cb-80c6-585c9a1feccb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1321 microversion: 2.1 time: 0.212957 Jul 18 10:48:01.318838 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 38/73] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:01 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:01.500725 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6bd646c1-f205-4b58-897e-12c47950673e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:01.501352 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-6bd646c1-f205-4b58-897e-12c47950673e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:01.507600 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6bd646c1-f205-4b58-897e-12c47950673e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:01.508044 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6bd646c1-f205-4b58-897e-12c47950673e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:01.508816 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6bd646c1-f205-4b58-897e-12c47950673e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:01.509247 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6bd646c1-f205-4b58-897e-12c47950673e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:01.552929 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0aaa522e-b2c1-443a-8d3a-5f175ab59b82 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:01.553468 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-0aaa522e-b2c1-443a-8d3a-5f175ab59b82 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:01.559798 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0aaa522e-b2c1-443a-8d3a-5f175ab59b82 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:01.560242 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0aaa522e-b2c1-443a-8d3a-5f175ab59b82 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:01.561025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0aaa522e-b2c1-443a-8d3a-5f175ab59b82 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:01.561515 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0aaa522e-b2c1-443a-8d3a-5f175ab59b82 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:01.715737 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6bd646c1-f205-4b58-897e-12c47950673e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:01.734585 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6bd646c1-f205-4b58-897e-12c47950673e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:01.736126 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6bd646c1-f205-4b58-897e-12c47950673e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:01.737346 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-6bd646c1-f205-4b58-897e-12c47950673e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1407 microversion: 2.20 time: 0.240475 Jul 18 10:48:01.737926 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 36/74] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:01 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:01.751294 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-0aaa522e-b2c1-443a-8d3a-5f175ab59b82 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:01.759730 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-0aaa522e-b2c1-443a-8d3a-5f175ab59b82 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1363 microversion: 2.1 time: 0.211371 Jul 18 10:48:01.760435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 39/75] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:01 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:01.821327 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6e5452c1-80e9-41d9-b4bb-2563bc76608f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:01.822271 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-6e5452c1-80e9-41d9-b4bb-2563bc76608f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:01.829673 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e5452c1-80e9-41d9-b4bb-2563bc76608f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:01.830660 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e5452c1-80e9-41d9-b4bb-2563bc76608f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:01.832869 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e5452c1-80e9-41d9-b4bb-2563bc76608f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:01.832869 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e5452c1-80e9-41d9-b4bb-2563bc76608f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:01.990728 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6e5452c1-80e9-41d9-b4bb-2563bc76608f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:01.998494 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-6e5452c1-80e9-41d9-b4bb-2563bc76608f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1314 microversion: 2.1 time: 0.182661 Jul 18 10:48:01.999079 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 37/76] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:01 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:02.318836 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d1520aee-2de6-4d41-a79e-f2c7b31addb7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:02.319445 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d1520aee-2de6-4d41-a79e-f2c7b31addb7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:02.327285 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d1520aee-2de6-4d41-a79e-f2c7b31addb7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:02.327875 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d1520aee-2de6-4d41-a79e-f2c7b31addb7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:02.328771 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d1520aee-2de6-4d41-a79e-f2c7b31addb7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:02.329252 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d1520aee-2de6-4d41-a79e-f2c7b31addb7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:02.340119 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f00372f7-c957-42c3-a54c-5637a163be30 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:02.340731 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f00372f7-c957-42c3-a54c-5637a163be30 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:02.342655 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=2 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:02.350064 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f00372f7-c957-42c3-a54c-5637a163be30 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:02.350655 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f00372f7-c957-42c3-a54c-5637a163be30 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:02.351752 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f00372f7-c957-42c3-a54c-5637a163be30 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:02.352424 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f00372f7-c957-42c3-a54c-5637a163be30 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:02.555772 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d1520aee-2de6-4d41-a79e-f2c7b31addb7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:02.563353 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d1520aee-2de6-4d41-a79e-f2c7b31addb7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1365 microversion: 2.1 time: 0.249711 Jul 18 10:48:02.563960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 40/77] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:02 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:02.572665 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f00372f7-c957-42c3-a54c-5637a163be30 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:02.581851 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f00372f7-c957-42c3-a54c-5637a163be30 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1321 microversion: 2.1 time: 0.245431 Jul 18 10:48:02.582827 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 38/78] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:02 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:02.759513 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-fd67fc2e-9a8d-4bb5-bb4e-21fadbcc3c3f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:02.760348 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-fd67fc2e-9a8d-4bb5-bb4e-21fadbcc3c3f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:02.767243 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fd67fc2e-9a8d-4bb5-bb4e-21fadbcc3c3f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:02.767510 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fd67fc2e-9a8d-4bb5-bb4e-21fadbcc3c3f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:02.768203 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fd67fc2e-9a8d-4bb5-bb4e-21fadbcc3c3f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:02.768996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fd67fc2e-9a8d-4bb5-bb4e-21fadbcc3c3f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:02.778543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e821edfa-635c-4dff-bb31-5dbf9db0633c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:02.779225 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e821edfa-635c-4dff-bb31-5dbf9db0633c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:02.798048 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e821edfa-635c-4dff-bb31-5dbf9db0633c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:02.798508 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e821edfa-635c-4dff-bb31-5dbf9db0633c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:02.799890 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e821edfa-635c-4dff-bb31-5dbf9db0633c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:02.800966 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e821edfa-635c-4dff-bb31-5dbf9db0633c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:03.006628 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-fd67fc2e-9a8d-4bb5-bb4e-21fadbcc3c3f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:03.015507 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-fd67fc2e-9a8d-4bb5-bb4e-21fadbcc3c3f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:03.017050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-fd67fc2e-9a8d-4bb5-bb4e-21fadbcc3c3f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:03.019028 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-fd67fc2e-9a8d-4bb5-bb4e-21fadbcc3c3f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1407 microversion: 2.20 time: 0.267036 Jul 18 10:48:03.019918 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 41/79] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:02 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:03.021147 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e821edfa-635c-4dff-bb31-5dbf9db0633c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:03.025108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-52fdf19b-89ee-4ed3-934f-ad829763392b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:03.025719 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-52fdf19b-89ee-4ed3-934f-ad829763392b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:03.033860 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e821edfa-635c-4dff-bb31-5dbf9db0633c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1363 microversion: 2.1 time: 0.258760 Jul 18 10:48:03.034495 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 39/80] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:02 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:03.035553 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-52fdf19b-89ee-4ed3-934f-ad829763392b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:03.036039 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-52fdf19b-89ee-4ed3-934f-ad829763392b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:03.037119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-52fdf19b-89ee-4ed3-934f-ad829763392b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:03.042543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-52fdf19b-89ee-4ed3-934f-ad829763392b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:03.185157 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-52fdf19b-89ee-4ed3-934f-ad829763392b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:03.194287 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-52fdf19b-89ee-4ed3-934f-ad829763392b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1314 microversion: 2.1 time: 0.173038 Jul 18 10:48:03.194876 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 42/81] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:03 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:03.582435 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5c9911d0-44a4-430f-9016-3548d497eb22 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:03.583179 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5c9911d0-44a4-430f-9016-3548d497eb22 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:03.590333 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c9911d0-44a4-430f-9016-3548d497eb22 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:03.590884 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c9911d0-44a4-430f-9016-3548d497eb22 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:03.591724 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c9911d0-44a4-430f-9016-3548d497eb22 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:03.592218 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c9911d0-44a4-430f-9016-3548d497eb22 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:03.608587 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4cbb553b-827a-453f-a03e-bfe64498cfd8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:03.613133 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-4cbb553b-827a-453f-a03e-bfe64498cfd8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:03.623135 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4cbb553b-827a-453f-a03e-bfe64498cfd8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:03.623955 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4cbb553b-827a-453f-a03e-bfe64498cfd8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:03.625500 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4cbb553b-827a-453f-a03e-bfe64498cfd8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:03.626677 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4cbb553b-827a-453f-a03e-bfe64498cfd8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:03.655387 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=4 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:03.859058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5c9911d0-44a4-430f-9016-3548d497eb22 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:03.862508 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-4cbb553b-827a-453f-a03e-bfe64498cfd8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:03.871366 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5c9911d0-44a4-430f-9016-3548d497eb22 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1365 microversion: 2.1 time: 0.293108 Jul 18 10:48:03.872600 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4cbb553b-827a-453f-a03e-bfe64498cfd8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1321 microversion: 2.1 time: 0.271833 Jul 18 10:48:03.873661 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 43/82] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:03 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:03.876335 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 40/83] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:03 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:04.039236 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-589da84e-7793-4a9e-a14d-00d7c15ffc21 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:04.039890 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-589da84e-7793-4a9e-a14d-00d7c15ffc21 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:04.049649 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-589da84e-7793-4a9e-a14d-00d7c15ffc21 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:04.050803 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-589da84e-7793-4a9e-a14d-00d7c15ffc21 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:04.052882 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-589da84e-7793-4a9e-a14d-00d7c15ffc21 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:04.053195 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-589da84e-7793-4a9e-a14d-00d7c15ffc21 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:04.067637 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-d98777b8-ef50-4b91-9a90-041bc2f9825f req-746a00a7-765b-4b40-b34b-95a3fd8f2de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1449a0db-3f38-4456-8a45-7b4a40105095", "name": "network-vif-plugged", "status": "completed", "tag": "fc6df403-f5e5-427c-868d-17653a05457d"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:04.076893 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-d98777b8-ef50-4b91-9a90-041bc2f9825f req-746a00a7-765b-4b40-b34b-95a3fd8f2de9 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:04.080995 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-d98777b8-ef50-4b91-9a90-041bc2f9825f req-746a00a7-765b-4b40-b34b-95a3fd8f2de9 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:04.091265 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-d98777b8-ef50-4b91-9a90-041bc2f9825f req-746a00a7-765b-4b40-b34b-95a3fd8f2de9 service nova] Creating event network-vif-plugged:fc6df403-f5e5-427c-868d-17653a05457d for instance 1449a0db-3f38-4456-8a45-7b4a40105095 on hv-cinder-84949 Jul 18 10:48:04.098490 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-d98777b8-ef50-4b91-9a90-041bc2f9825f req-746a00a7-765b-4b40-b34b-95a3fd8f2de9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105833 Jul 18 10:48:04.099769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 44/84] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:04.110309 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-cc1d37f1-39f4-4655-a8d0-371d8d3d1c55 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:04.110567 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-cc1d37f1-39f4-4655-a8d0-371d8d3d1c55 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:04.131754 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cc1d37f1-39f4-4655-a8d0-371d8d3d1c55 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:04.132652 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cc1d37f1-39f4-4655-a8d0-371d8d3d1c55 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:04.133346 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cc1d37f1-39f4-4655-a8d0-371d8d3d1c55 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:04.133801 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cc1d37f1-39f4-4655-a8d0-371d8d3d1c55 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:04.463468 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-589da84e-7793-4a9e-a14d-00d7c15ffc21 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:04.474120 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-589da84e-7793-4a9e-a14d-00d7c15ffc21 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:04.475085 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-cc1d37f1-39f4-4655-a8d0-371d8d3d1c55 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:04.475846 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-589da84e-7793-4a9e-a14d-00d7c15ffc21 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:04.477119 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-589da84e-7793-4a9e-a14d-00d7c15ffc21 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1407 microversion: 2.20 time: 0.442634 Jul 18 10:48:04.478506 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 41/85] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:04 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:04.492202 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-455e6f47-b55b-4de2-b2dd-1633371de139 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:04.495335 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-455e6f47-b55b-4de2-b2dd-1633371de139 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:04.495695 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-cc1d37f1-39f4-4655-a8d0-371d8d3d1c55 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1363 microversion: 2.1 time: 0.393055 Jul 18 10:48:04.498543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 45/86] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:04 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1363 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:04.510778 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-455e6f47-b55b-4de2-b2dd-1633371de139 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:04.511300 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-455e6f47-b55b-4de2-b2dd-1633371de139 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:04.512107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-455e6f47-b55b-4de2-b2dd-1633371de139 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:04.512547 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-455e6f47-b55b-4de2-b2dd-1633371de139 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:04.772208 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-455e6f47-b55b-4de2-b2dd-1633371de139 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:04.800249 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-455e6f47-b55b-4de2-b2dd-1633371de139 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1314 microversion: 2.1 time: 0.318830 Jul 18 10:48:04.812252 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 42/87] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:04 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:04.894280 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ea88519f-9b9c-4e50-8a30-2851e90529db tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:04.894847 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d1a9106f-2759-4a70-b678-798e2a1cf01e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:04.895439 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d1a9106f-2759-4a70-b678-798e2a1cf01e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:04.896210 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ea88519f-9b9c-4e50-8a30-2851e90529db tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:04.904516 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ea88519f-9b9c-4e50-8a30-2851e90529db tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:04.905462 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ea88519f-9b9c-4e50-8a30-2851e90529db tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:04.909278 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ea88519f-9b9c-4e50-8a30-2851e90529db tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:04.909278 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ea88519f-9b9c-4e50-8a30-2851e90529db tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:04.909494 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d1a9106f-2759-4a70-b678-798e2a1cf01e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:04.912114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d1a9106f-2759-4a70-b678-798e2a1cf01e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:04.913499 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d1a9106f-2759-4a70-b678-798e2a1cf01e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:04.913959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d1a9106f-2759-4a70-b678-798e2a1cf01e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:05.192520 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ea88519f-9b9c-4e50-8a30-2851e90529db tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:05.204679 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ea88519f-9b9c-4e50-8a30-2851e90529db tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1321 microversion: 2.1 time: 0.316460 Jul 18 10:48:05.216409 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 46/88] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:04 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:05.253331 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-d1a9106f-2759-4a70-b678-798e2a1cf01e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:05.273972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d1a9106f-2759-4a70-b678-798e2a1cf01e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1365 microversion: 2.1 time: 0.383678 Jul 18 10:48:05.275079 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 43/89] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:04 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1365 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:05.508531 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-50200b05-9885-4a07-83b5-067c9b24a3e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:05.509543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-50200b05-9885-4a07-83b5-067c9b24a3e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:05.518508 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-50200b05-9885-4a07-83b5-067c9b24a3e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:05.519266 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-50200b05-9885-4a07-83b5-067c9b24a3e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:05.520277 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-50200b05-9885-4a07-83b5-067c9b24a3e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:05.521111 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-50200b05-9885-4a07-83b5-067c9b24a3e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:05.525025 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-58dad65a-1c63-4110-893f-ba043ec481e5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:05.525845 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-58dad65a-1c63-4110-893f-ba043ec481e5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:05.532753 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-58dad65a-1c63-4110-893f-ba043ec481e5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:05.539124 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-58dad65a-1c63-4110-893f-ba043ec481e5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:05.539124 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-58dad65a-1c63-4110-893f-ba043ec481e5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:05.539124 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-58dad65a-1c63-4110-893f-ba043ec481e5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:06.085531 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-58dad65a-1c63-4110-893f-ba043ec481e5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:06.098898 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-58dad65a-1c63-4110-893f-ba043ec481e5 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1363 microversion: 2.1 time: 0.577579 Jul 18 10:48:06.100132 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 44/90] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:05 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1363 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:06.119541 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-717bcb85-4347-4060-a6c3-59c55f274718 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:06.120820 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-717bcb85-4347-4060-a6c3-59c55f274718 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:06.122968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-50200b05-9885-4a07-83b5-067c9b24a3e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:06.137002 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-717bcb85-4347-4060-a6c3-59c55f274718 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:06.137742 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-717bcb85-4347-4060-a6c3-59c55f274718 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:06.138901 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-50200b05-9885-4a07-83b5-067c9b24a3e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:06.139071 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-717bcb85-4347-4060-a6c3-59c55f274718 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:06.139715 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-717bcb85-4347-4060-a6c3-59c55f274718 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:06.142082 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-50200b05-9885-4a07-83b5-067c9b24a3e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:06.144811 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-50200b05-9885-4a07-83b5-067c9b24a3e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1407 microversion: 2.20 time: 0.640810 Jul 18 10:48:06.161461 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 47/91] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:05 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1407 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:48:06.174894 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-04f09c78-5238-4cd3-98bd-595f58db7816 req-8f48630e-c662-4ac5-99f6-508994ad894f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f96ccdd-67b5-403c-a3b9-8022e271690c", "name": "network-vif-plugged", "status": "completed", "tag": "820fb007-4789-49d7-84d1-ecf34d4d542f"}, {"server_uuid": "4728713a-e4cd-4e09-b104-7a57de4f2242", "name": "network-vif-plugged", "status": "completed", "tag": "a2d9794f-2a33-4778-92a2-20c4de5af12b"}, {"server_uuid": "448b223d-269c-44ab-9fb8-01e1f863ee49", "name": "network-vif-plugged", "status": "completed", "tag": "a660016a-47a5-4610-b64d-eed8b0819a10"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:06.192807 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-04f09c78-5238-4cd3-98bd-595f58db7816 req-8f48630e-c662-4ac5-99f6-508994ad894f service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:06.193753 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-04f09c78-5238-4cd3-98bd-595f58db7816 req-8f48630e-c662-4ac5-99f6-508994ad894f service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:06.222920 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-04f09c78-5238-4cd3-98bd-595f58db7816 req-8f48630e-c662-4ac5-99f6-508994ad894f service nova] Creating event network-vif-plugged:820fb007-4789-49d7-84d1-ecf34d4d542f for instance 0f96ccdd-67b5-403c-a3b9-8022e271690c on hv-cinder-84949 Jul 18 10:48:06.223790 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-04f09c78-5238-4cd3-98bd-595f58db7816 req-8f48630e-c662-4ac5-99f6-508994ad894f service nova] Creating event network-vif-plugged:a2d9794f-2a33-4778-92a2-20c4de5af12b for instance 4728713a-e4cd-4e09-b104-7a57de4f2242 on hv-cinder-84949 Jul 18 10:48:06.229162 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-04f09c78-5238-4cd3-98bd-595f58db7816 req-8f48630e-c662-4ac5-99f6-508994ad894f service nova] Creating event network-vif-plugged:a660016a-47a5-4610-b64d-eed8b0819a10 for instance 448b223d-269c-44ab-9fb8-01e1f863ee49 on hv-cinder-84949 Jul 18 10:48:06.256528 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-04f09c78-5238-4cd3-98bd-595f58db7816 req-8f48630e-c662-4ac5-99f6-508994ad894f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.093246 Jul 18 10:48:06.259495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 48/92] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:06.273596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-20629198-08de-4af8-82b5-b42805f33d61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:06.274298 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-20629198-08de-4af8-82b5-b42805f33d61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:06.285246 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-20629198-08de-4af8-82b5-b42805f33d61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:06.286246 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-20629198-08de-4af8-82b5-b42805f33d61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:06.287624 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-20629198-08de-4af8-82b5-b42805f33d61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:06.288805 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-20629198-08de-4af8-82b5-b42805f33d61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:06.503606 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-717bcb85-4347-4060-a6c3-59c55f274718 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:06.511973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-717bcb85-4347-4060-a6c3-59c55f274718 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1314 microversion: 2.1 time: 0.409962 Jul 18 10:48:06.515654 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 45/93] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:06 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:06.518392 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e15e47ed-ab09-4c7a-a2d8-261786e0d6cc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:06.519149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e15e47ed-ab09-4c7a-a2d8-261786e0d6cc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:06.525495 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e15e47ed-ab09-4c7a-a2d8-261786e0d6cc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:06.525998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e15e47ed-ab09-4c7a-a2d8-261786e0d6cc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:06.526741 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e15e47ed-ab09-4c7a-a2d8-261786e0d6cc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:06.527258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e15e47ed-ab09-4c7a-a2d8-261786e0d6cc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:06.556645 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-20629198-08de-4af8-82b5-b42805f33d61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:06.575945 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-20629198-08de-4af8-82b5-b42805f33d61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1321 microversion: 2.1 time: 0.314092 Jul 18 10:48:06.577383 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 49/94] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:06 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:06.744681 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e15e47ed-ab09-4c7a-a2d8-261786e0d6cc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:06.774700 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e15e47ed-ab09-4c7a-a2d8-261786e0d6cc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1365 microversion: 2.1 time: 0.260596 Jul 18 10:48:06.780848 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 46/95] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:06 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:07.119865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-97e8c0bd-9d1a-4510-b797-6c66f8150ea0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:07.121099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-97e8c0bd-9d1a-4510-b797-6c66f8150ea0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:07.130944 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-97e8c0bd-9d1a-4510-b797-6c66f8150ea0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:07.131981 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-97e8c0bd-9d1a-4510-b797-6c66f8150ea0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:07.133055 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-97e8c0bd-9d1a-4510-b797-6c66f8150ea0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:07.133686 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-97e8c0bd-9d1a-4510-b797-6c66f8150ea0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:07.179637 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-ece9abd9-affa-41fa-8ae7-de27d8301e0b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:07.180384 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-ece9abd9-affa-41fa-8ae7-de27d8301e0b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:07.188686 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ece9abd9-affa-41fa-8ae7-de27d8301e0b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:07.189268 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ece9abd9-affa-41fa-8ae7-de27d8301e0b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:07.192109 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ece9abd9-affa-41fa-8ae7-de27d8301e0b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:07.192689 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ece9abd9-affa-41fa-8ae7-de27d8301e0b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:07.448992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-97e8c0bd-9d1a-4510-b797-6c66f8150ea0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:07.460332 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-97e8c0bd-9d1a-4510-b797-6c66f8150ea0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1363 microversion: 2.1 time: 0.346051 Jul 18 10:48:07.461337 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 50/96] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:07 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:07.463743 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ece9abd9-affa-41fa-8ae7-de27d8301e0b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:07.474615 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ece9abd9-affa-41fa-8ae7-de27d8301e0b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:07.477123 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ece9abd9-affa-41fa-8ae7-de27d8301e0b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:07.478258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-ece9abd9-affa-41fa-8ae7-de27d8301e0b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1407 microversion: 2.20 time: 0.305131 Jul 18 10:48:07.478826 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 47/97] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:07 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:07.533483 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b694fd39-2737-433e-8bad-e7dc920fb706 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:07.534625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b694fd39-2737-433e-8bad-e7dc920fb706 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:07.545280 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b694fd39-2737-433e-8bad-e7dc920fb706 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:07.546035 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b694fd39-2737-433e-8bad-e7dc920fb706 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:07.547265 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b694fd39-2737-433e-8bad-e7dc920fb706 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:07.547819 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b694fd39-2737-433e-8bad-e7dc920fb706 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:07.603743 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c2799dc7-fe13-474d-979e-e836a06a89bf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:07.604863 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c2799dc7-fe13-474d-979e-e836a06a89bf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:07.613984 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c2799dc7-fe13-474d-979e-e836a06a89bf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:07.614432 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c2799dc7-fe13-474d-979e-e836a06a89bf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:07.615664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c2799dc7-fe13-474d-979e-e836a06a89bf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:07.616179 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c2799dc7-fe13-474d-979e-e836a06a89bf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:07.929832 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c2799dc7-fe13-474d-979e-e836a06a89bf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:07.935509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b694fd39-2737-433e-8bad-e7dc920fb706 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:07.941280 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c2799dc7-fe13-474d-979e-e836a06a89bf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1321 microversion: 2.1 time: 0.341739 Jul 18 10:48:07.942029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 48/98] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:07 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:07.948532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8b093f42-be23-4fc3-b6f1-6963e0394b84 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:07.949375 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8b093f42-be23-4fc3-b6f1-6963e0394b84 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:07.951060 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b694fd39-2737-433e-8bad-e7dc920fb706 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1314 microversion: 2.1 time: 0.424245 Jul 18 10:48:07.952419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 51/99] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:07 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:07.959905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8b093f42-be23-4fc3-b6f1-6963e0394b84 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:07.961926 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8b093f42-be23-4fc3-b6f1-6963e0394b84 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:07.963418 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8b093f42-be23-4fc3-b6f1-6963e0394b84 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:07.964205 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8b093f42-be23-4fc3-b6f1-6963e0394b84 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:08.159202 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8b093f42-be23-4fc3-b6f1-6963e0394b84 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:08.167962 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8b093f42-be23-4fc3-b6f1-6963e0394b84 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1365 microversion: 2.1 time: 0.224389 Jul 18 10:48:08.168572 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 49/100] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:07 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:08.489304 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-60c439d4-e925-4f9b-b1cf-5af43393b567 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:08.490112 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-60c439d4-e925-4f9b-b1cf-5af43393b567 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:08.499542 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-60c439d4-e925-4f9b-b1cf-5af43393b567 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:08.509500 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-1e1726ac-e773-4c8a-bc99-303c51fe753a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:08.510170 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-1e1726ac-e773-4c8a-bc99-303c51fe753a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:08.512351 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-60c439d4-e925-4f9b-b1cf-5af43393b567 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:08.514738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-60c439d4-e925-4f9b-b1cf-5af43393b567 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:08.515948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-60c439d4-e925-4f9b-b1cf-5af43393b567 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:08.521577 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1e1726ac-e773-4c8a-bc99-303c51fe753a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:08.522128 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1e1726ac-e773-4c8a-bc99-303c51fe753a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:08.522997 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1e1726ac-e773-4c8a-bc99-303c51fe753a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:08.523641 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1e1726ac-e773-4c8a-bc99-303c51fe753a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:08.827175 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-1e1726ac-e773-4c8a-bc99-303c51fe753a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:08.845759 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-1e1726ac-e773-4c8a-bc99-303c51fe753a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:08.849787 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-1e1726ac-e773-4c8a-bc99-303c51fe753a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:08.852350 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-1e1726ac-e773-4c8a-bc99-303c51fe753a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1407 microversion: 2.20 time: 0.348915 Jul 18 10:48:08.853672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-60c439d4-e925-4f9b-b1cf-5af43393b567 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:08.854181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 50/101] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:08 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:08.870642 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-60c439d4-e925-4f9b-b1cf-5af43393b567 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1363 microversion: 2.1 time: 0.386096 Jul 18 10:48:08.873432 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 52/102] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:08 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1363 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:08.973517 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-42caa4b2-3535-4c02-96cf-19035462ecbc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:08.975792 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-42caa4b2-3535-4c02-96cf-19035462ecbc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:08.995472 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-fa28c424-f147-4d49-9c6d-1bce956e92bd tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:09.005067 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-42caa4b2-3535-4c02-96cf-19035462ecbc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:09.005067 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-42caa4b2-3535-4c02-96cf-19035462ecbc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:09.005067 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-42caa4b2-3535-4c02-96cf-19035462ecbc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:09.005067 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-42caa4b2-3535-4c02-96cf-19035462ecbc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:09.007913 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-fa28c424-f147-4d49-9c6d-1bce956e92bd tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:09.018603 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fa28c424-f147-4d49-9c6d-1bce956e92bd tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:09.019161 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fa28c424-f147-4d49-9c6d-1bce956e92bd tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:09.019961 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fa28c424-f147-4d49-9c6d-1bce956e92bd tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:09.020396 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fa28c424-f147-4d49-9c6d-1bce956e92bd tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:09.025535 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=100 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:09.336447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-42caa4b2-3535-4c02-96cf-19035462ecbc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:09.353705 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-42caa4b2-3535-4c02-96cf-19035462ecbc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1515 microversion: 2.1 time: 0.387932 Jul 18 10:48:09.353975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 51/103] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:08 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1515 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:09.360349 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e6d35be5-e9dc-4938-9d17-72114111685c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:09.362016 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e6d35be5-e9dc-4938-9d17-72114111685c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:09.369915 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e6d35be5-e9dc-4938-9d17-72114111685c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:09.370616 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e6d35be5-e9dc-4938-9d17-72114111685c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:09.371583 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e6d35be5-e9dc-4938-9d17-72114111685c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:09.372029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e6d35be5-e9dc-4938-9d17-72114111685c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:09.389076 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-fa28c424-f147-4d49-9c6d-1bce956e92bd tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:09.412833 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-fa28c424-f147-4d49-9c6d-1bce956e92bd tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1314 microversion: 2.1 time: 0.429019 Jul 18 10:48:09.414955 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 53/104] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:08 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:09.430372 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-fcf950e8-183a-490f-8ad9-8f51b79043b0 req-f40b43b1-2de1-485f-977c-8bee22cc14f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadfa860-196c-4946-85a4-a9a2aed7c1b7", "name": "network-vif-plugged", "status": "completed", "tag": "dce7face-5f9b-40f7-8b3c-e6b845457a5e"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:09.452477 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-fcf950e8-183a-490f-8ad9-8f51b79043b0 req-f40b43b1-2de1-485f-977c-8bee22cc14f9 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:09.453834 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-fcf950e8-183a-490f-8ad9-8f51b79043b0 req-f40b43b1-2de1-485f-977c-8bee22cc14f9 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:09.491566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-fcf950e8-183a-490f-8ad9-8f51b79043b0 req-f40b43b1-2de1-485f-977c-8bee22cc14f9 service nova] Creating event network-vif-plugged:dce7face-5f9b-40f7-8b3c-e6b845457a5e for instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 on hv-cinder-84949 Jul 18 10:48:09.507249 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-fcf950e8-183a-490f-8ad9-8f51b79043b0 req-f40b43b1-2de1-485f-977c-8bee22cc14f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088925 Jul 18 10:48:09.510030 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 54/105] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:09.539480 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-60ec6c1a-5cf3-442e-a211-5c81bd21a42e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:09.540765 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-60ec6c1a-5cf3-442e-a211-5c81bd21a42e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:09.553283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-60ec6c1a-5cf3-442e-a211-5c81bd21a42e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:09.554617 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-60ec6c1a-5cf3-442e-a211-5c81bd21a42e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:09.556965 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-60ec6c1a-5cf3-442e-a211-5c81bd21a42e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:09.557951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-60ec6c1a-5cf3-442e-a211-5c81bd21a42e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:09.615774 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=100 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:09.639148 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e6d35be5-e9dc-4938-9d17-72114111685c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:09.663413 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e6d35be5-e9dc-4938-9d17-72114111685c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1365 microversion: 2.1 time: 0.307466 Jul 18 10:48:09.664860 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 52/106] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:09 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:09.690743 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-60ec6c1a-5cf3-442e-a211-5c81bd21a42e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lazy-loading 'flavor' on Instance uuid 1449a0db-3f38-4456-8a45-7b4a40105095 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:48:09.875588 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-51c17761-4111-4acc-9066-0c1bf4f0b434 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:09.876632 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-51c17761-4111-4acc-9066-0c1bf4f0b434 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:09.887940 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-51c17761-4111-4acc-9066-0c1bf4f0b434 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:09.889078 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-51c17761-4111-4acc-9066-0c1bf4f0b434 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:09.890644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-51c17761-4111-4acc-9066-0c1bf4f0b434 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:09.891503 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-51c17761-4111-4acc-9066-0c1bf4f0b434 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.094129 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-60ec6c1a-5cf3-442e-a211-5c81bd21a42e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "POST /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095/action" status: 200 len: 32 microversion: 2.1 time: 0.581696 Jul 18 10:48:10.101580 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 55/107] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 18 10:48:09 2022] POST /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095/action => generated 32 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:48:10.113967 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ae5a2d6a-01a1-4d9c-8751-de4eb0b15861 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:10.114946 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ae5a2d6a-01a1-4d9c-8751-de4eb0b15861 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:10.128598 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ae5a2d6a-01a1-4d9c-8751-de4eb0b15861 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.129200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ae5a2d6a-01a1-4d9c-8751-de4eb0b15861 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.132696 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ae5a2d6a-01a1-4d9c-8751-de4eb0b15861 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.134471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ae5a2d6a-01a1-4d9c-8751-de4eb0b15861 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.156065 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-51c17761-4111-4acc-9066-0c1bf4f0b434 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:10.163673 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-51c17761-4111-4acc-9066-0c1bf4f0b434 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:10.165168 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-51c17761-4111-4acc-9066-0c1bf4f0b434 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:10.166506 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-51c17761-4111-4acc-9066-0c1bf4f0b434 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1407 microversion: 2.20 time: 0.297670 Jul 18 10:48:10.167083 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 53/108] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:09 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:48:10.171988 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c54c8802-333a-42d0-ba6e-11c5edd4efaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:10.172928 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c54c8802-333a-42d0-ba6e-11c5edd4efaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:10.184808 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c54c8802-333a-42d0-ba6e-11c5edd4efaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.185996 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c54c8802-333a-42d0-ba6e-11c5edd4efaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.187352 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c54c8802-333a-42d0-ba6e-11c5edd4efaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.188116 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c54c8802-333a-42d0-ba6e-11c5edd4efaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.404007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ae5a2d6a-01a1-4d9c-8751-de4eb0b15861 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:10.413765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c54c8802-333a-42d0-ba6e-11c5edd4efaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:10.421975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c54c8802-333a-42d0-ba6e-11c5edd4efaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.253461 Jul 18 10:48:10.424883 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 54/109] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:10 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:10.437214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-288512e8-05ba-47df-8099-31732b7bdb32 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:10.438061 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-288512e8-05ba-47df-8099-31732b7bdb32 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:10.446615 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-288512e8-05ba-47df-8099-31732b7bdb32 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.447449 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-288512e8-05ba-47df-8099-31732b7bdb32 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.448455 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-288512e8-05ba-47df-8099-31732b7bdb32 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.448667 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ae5a2d6a-01a1-4d9c-8751-de4eb0b15861 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1363 microversion: 2.1 time: 0.346261 Jul 18 10:48:10.449379 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-288512e8-05ba-47df-8099-31732b7bdb32 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.449491 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 56/110] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:10 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:10.646354 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-288512e8-05ba-47df-8099-31732b7bdb32 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:10.654971 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-288512e8-05ba-47df-8099-31732b7bdb32 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1502 microversion: 2.1 time: 0.225233 Jul 18 10:48:10.662777 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 55/111] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:10 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:10.681556 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4976cad5-eccb-4504-b76f-c5a4c0ab1f09 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:10.682162 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-4976cad5-eccb-4504-b76f-c5a4c0ab1f09 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:10.688868 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4976cad5-eccb-4504-b76f-c5a4c0ab1f09 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.689377 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4976cad5-eccb-4504-b76f-c5a4c0ab1f09 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.690652 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4976cad5-eccb-4504-b76f-c5a4c0ab1f09 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.691256 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4976cad5-eccb-4504-b76f-c5a4c0ab1f09 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.933639 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-4976cad5-eccb-4504-b76f-c5a4c0ab1f09 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:10.946776 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4976cad5-eccb-4504-b76f-c5a4c0ab1f09 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1365 microversion: 2.1 time: 0.268984 Jul 18 10:48:10.950675 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 57/112] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:10 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:11.188579 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bfd7eaf8-93a4-4d55-b246-3c0114e1720e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:11.189921 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-bfd7eaf8-93a4-4d55-b246-3c0114e1720e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:11.197710 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bfd7eaf8-93a4-4d55-b246-3c0114e1720e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.198367 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bfd7eaf8-93a4-4d55-b246-3c0114e1720e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.200157 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bfd7eaf8-93a4-4d55-b246-3c0114e1720e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.200805 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bfd7eaf8-93a4-4d55-b246-3c0114e1720e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.468118 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-257c29ad-6654-4b46-ba77-fd970dbb3204 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:11.469592 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-257c29ad-6654-4b46-ba77-fd970dbb3204 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:11.483679 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-257c29ad-6654-4b46-ba77-fd970dbb3204 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.484843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-257c29ad-6654-4b46-ba77-fd970dbb3204 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.486091 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-257c29ad-6654-4b46-ba77-fd970dbb3204 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.486755 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-257c29ad-6654-4b46-ba77-fd970dbb3204 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.493231 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bfd7eaf8-93a4-4d55-b246-3c0114e1720e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:11.511503 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bfd7eaf8-93a4-4d55-b246-3c0114e1720e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:11.512147 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bfd7eaf8-93a4-4d55-b246-3c0114e1720e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:11.513589 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-bfd7eaf8-93a4-4d55-b246-3c0114e1720e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1407 microversion: 2.20 time: 0.330235 Jul 18 10:48:11.524905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 56/113] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:11 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:11.530623 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9d5e3661-d977-411d-b856-815ed530ef03 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:11.531424 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-9d5e3661-d977-411d-b856-815ed530ef03 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:11.539299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9d5e3661-d977-411d-b856-815ed530ef03 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.539845 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9d5e3661-d977-411d-b856-815ed530ef03 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.540513 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9d5e3661-d977-411d-b856-815ed530ef03 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.540979 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9d5e3661-d977-411d-b856-815ed530ef03 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.781254 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-257c29ad-6654-4b46-ba77-fd970dbb3204 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:11.795610 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-257c29ad-6654-4b46-ba77-fd970dbb3204 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.334904 Jul 18 10:48:11.796858 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 58/114] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:11 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:11.814171 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-24c6f147-232e-4e98-9e0f-7a118134f507 req-87cdf710-9c3a-4ef6-bfab-258ba4254dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d05192-b009-41ab-861b-b66d0352d41e", "name": "network-vif-plugged", "status": "completed", "tag": "abd1fe5c-3f12-4f5e-a659-6f5e05dab0ae"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:11.825160 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-24c6f147-232e-4e98-9e0f-7a118134f507 req-87cdf710-9c3a-4ef6-bfab-258ba4254dcd service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.825601 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-24c6f147-232e-4e98-9e0f-7a118134f507 req-87cdf710-9c3a-4ef6-bfab-258ba4254dcd service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.838922 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-24c6f147-232e-4e98-9e0f-7a118134f507 req-87cdf710-9c3a-4ef6-bfab-258ba4254dcd service nova] Creating event network-vif-plugged:abd1fe5c-3f12-4f5e-a659-6f5e05dab0ae for instance 14d05192-b009-41ab-861b-b66d0352d41e on hv-cinder-84949 Jul 18 10:48:11.844696 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-24c6f147-232e-4e98-9e0f-7a118134f507 req-87cdf710-9c3a-4ef6-bfab-258ba4254dcd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034748 Jul 18 10:48:11.845961 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 59/115] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:11.855951 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9d5e3661-d977-411d-b856-815ed530ef03 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:11.867495 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9d5e3661-d977-411d-b856-815ed530ef03 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1549 microversion: 2.1 time: 0.350775 Jul 18 10:48:11.868385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 57/116] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:11 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1549 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:11.899159 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e43087e9-a3b2-4617-8298-4cd33f7f3697 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:11.899897 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-e43087e9-a3b2-4617-8298-4cd33f7f3697 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:11.903423 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:11.908585 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e43087e9-a3b2-4617-8298-4cd33f7f3697 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.909380 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e43087e9-a3b2-4617-8298-4cd33f7f3697 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.910229 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e43087e9-a3b2-4617-8298-4cd33f7f3697 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.910822 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e43087e9-a3b2-4617-8298-4cd33f7f3697 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.966436 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6fe7a422-4e84-4739-9669-cf518a18074d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:11.967099 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-6fe7a422-4e84-4739-9669-cf518a18074d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:11.980156 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6fe7a422-4e84-4739-9669-cf518a18074d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.980816 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6fe7a422-4e84-4739-9669-cf518a18074d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.990241 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6fe7a422-4e84-4739-9669-cf518a18074d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.990241 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6fe7a422-4e84-4739-9669-cf518a18074d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:12.025677 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e43087e9-a3b2-4617-8298-4cd33f7f3697 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131192 Jul 18 10:48:12.028031 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 60/117] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 18 10:48:11 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:12.206093 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6fe7a422-4e84-4739-9669-cf518a18074d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:12.232906 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-6fe7a422-4e84-4739-9669-cf518a18074d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1365 microversion: 2.1 time: 0.267713 Jul 18 10:48:12.236232 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 58/118] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:11 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:12.533805 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6e87f241-96d1-4d65-b225-0158f44d8446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:12.534433 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6e87f241-96d1-4d65-b225-0158f44d8446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:12.543732 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6e87f241-96d1-4d65-b225-0158f44d8446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:12.544836 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6e87f241-96d1-4d65-b225-0158f44d8446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:12.549469 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6e87f241-96d1-4d65-b225-0158f44d8446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:12.549469 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6e87f241-96d1-4d65-b225-0158f44d8446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:12.755634 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-6e87f241-96d1-4d65-b225-0158f44d8446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:12.771833 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-6e87f241-96d1-4d65-b225-0158f44d8446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:12.775252 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-6e87f241-96d1-4d65-b225-0158f44d8446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:12.777316 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6e87f241-96d1-4d65-b225-0158f44d8446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1407 microversion: 2.20 time: 0.247795 Jul 18 10:48:12.779198 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 61/119] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:12 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:12.816749 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-4877896f-39e9-4aa0-9f3b-e2ba127bf390 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:12.817609 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-4877896f-39e9-4aa0-9f3b-e2ba127bf390 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:12.824610 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4877896f-39e9-4aa0-9f3b-e2ba127bf390 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:12.825087 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4877896f-39e9-4aa0-9f3b-e2ba127bf390 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:12.825882 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4877896f-39e9-4aa0-9f3b-e2ba127bf390 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:12.826393 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4877896f-39e9-4aa0-9f3b-e2ba127bf390 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:12.931751 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-55191249-58b1-435a-92bb-ba4ddab15558 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a67d4162-6a78-444d-891e-a4db9382d850"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:12.934251 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-55191249-58b1-435a-92bb-ba4ddab15558 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:12.942542 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-55191249-58b1-435a-92bb-ba4ddab15558 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:12.951102 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-55191249-58b1-435a-92bb-ba4ddab15558 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:12.951102 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-55191249-58b1-435a-92bb-ba4ddab15558 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:12.951102 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-55191249-58b1-435a-92bb-ba4ddab15558 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:13.083559 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4877896f-39e9-4aa0-9f3b-e2ba127bf390 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:13.093404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-4877896f-39e9-4aa0-9f3b-e2ba127bf390 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.281847 Jul 18 10:48:13.106621 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 59/120] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:12 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:13.253498 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-14174226-f131-43fa-8df0-5a055335b904 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:13.254427 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-14174226-f131-43fa-8df0-5a055335b904 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:13.261644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-14174226-f131-43fa-8df0-5a055335b904 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:13.262648 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-14174226-f131-43fa-8df0-5a055335b904 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:13.264193 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-14174226-f131-43fa-8df0-5a055335b904 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:13.264602 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-14174226-f131-43fa-8df0-5a055335b904 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:13.549229 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-14174226-f131-43fa-8df0-5a055335b904 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:13.558908 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-14174226-f131-43fa-8df0-5a055335b904 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1365 microversion: 2.1 time: 0.309897 Jul 18 10:48:13.562457 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 60/121] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:13 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:13.807437 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-ad3b07fa-a278-4014-8a42-15bfd1aece0f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:13.811204 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-ad3b07fa-a278-4014-8a42-15bfd1aece0f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:13.826671 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ad3b07fa-a278-4014-8a42-15bfd1aece0f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:13.827847 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ad3b07fa-a278-4014-8a42-15bfd1aece0f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:13.829605 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ad3b07fa-a278-4014-8a42-15bfd1aece0f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:13.831693 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ad3b07fa-a278-4014-8a42-15bfd1aece0f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:14.131886 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ad3b07fa-a278-4014-8a42-15bfd1aece0f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:14.161596 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ad3b07fa-a278-4014-8a42-15bfd1aece0f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:14.172247 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ad3b07fa-a278-4014-8a42-15bfd1aece0f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:14.175810 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-ad3b07fa-a278-4014-8a42-15bfd1aece0f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1407 microversion: 2.20 time: 0.373257 Jul 18 10:48:14.188294 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 61/122] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:13 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1407 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:14.188916 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-03a32687-2cfd-458f-b2b8-520c67a5656d req-6d689e13-72d8-4be4-a080-e2d4e8dc4bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f96ccdd-67b5-403c-a3b9-8022e271690c", "tag": "820fb007-4789-49d7-84d1-ecf34d4d542f"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:14.216681 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-03a32687-2cfd-458f-b2b8-520c67a5656d req-6d689e13-72d8-4be4-a080-e2d4e8dc4bd4 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:14.217384 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-03a32687-2cfd-458f-b2b8-520c67a5656d req-6d689e13-72d8-4be4-a080-e2d4e8dc4bd4 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:14.254756 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-03a32687-2cfd-458f-b2b8-520c67a5656d req-6d689e13-72d8-4be4-a080-e2d4e8dc4bd4 service nova] Creating event network-changed:820fb007-4789-49d7-84d1-ecf34d4d542f for instance 0f96ccdd-67b5-403c-a3b9-8022e271690c on hv-cinder-84949 Jul 18 10:48:14.269534 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-03a32687-2cfd-458f-b2b8-520c67a5656d req-6d689e13-72d8-4be4-a080-e2d4e8dc4bd4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087426 Jul 18 10:48:14.271931 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 62/123] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:14.277638 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-73ae4f5a-4d05-4ed0-a917-ee8c259e2419 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:14.278406 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-73ae4f5a-4d05-4ed0-a917-ee8c259e2419 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:14.293931 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-73ae4f5a-4d05-4ed0-a917-ee8c259e2419 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:14.294400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-73ae4f5a-4d05-4ed0-a917-ee8c259e2419 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:14.295275 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-73ae4f5a-4d05-4ed0-a917-ee8c259e2419 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:14.295949 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-73ae4f5a-4d05-4ed0-a917-ee8c259e2419 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:14.430284 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-55191249-58b1-435a-92bb-ba4ddab15558 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "POST /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.496047 Jul 18 10:48:14.430284 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 62/124] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 18 10:48:12 2022] POST /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49/os-volume_attachments => generated 194 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:48:14.587004 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d9c204dd-b2fd-47c9-aeee-afd73867ec8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:14.588640 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d9c204dd-b2fd-47c9-aeee-afd73867ec8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:14.600820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d9c204dd-b2fd-47c9-aeee-afd73867ec8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:14.601261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d9c204dd-b2fd-47c9-aeee-afd73867ec8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:14.602383 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d9c204dd-b2fd-47c9-aeee-afd73867ec8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:14.603021 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d9c204dd-b2fd-47c9-aeee-afd73867ec8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:15.023678 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-73ae4f5a-4d05-4ed0-a917-ee8c259e2419 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:15.037601 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-73ae4f5a-4d05-4ed0-a917-ee8c259e2419 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.764147 Jul 18 10:48:15.038400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 63/125] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:14 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:15.118543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d9c204dd-b2fd-47c9-aeee-afd73867ec8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:15.125379 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d9c204dd-b2fd-47c9-aeee-afd73867ec8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1554 microversion: 2.1 time: 0.543219 Jul 18 10:48:15.125963 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 63/126] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:14 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1554 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:15.143566 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e51e840a-0fb1-41c2-9755-064e2878b14a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:15.144067 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e51e840a-0fb1-41c2-9755-064e2878b14a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:15.150504 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e51e840a-0fb1-41c2-9755-064e2878b14a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:15.150939 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e51e840a-0fb1-41c2-9755-064e2878b14a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:15.151913 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e51e840a-0fb1-41c2-9755-064e2878b14a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:15.152489 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e51e840a-0fb1-41c2-9755-064e2878b14a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:15.196447 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b49d332b-e5e1-415f-ac1f-911e31142bd9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:15.197418 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b49d332b-e5e1-415f-ac1f-911e31142bd9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:15.207795 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b49d332b-e5e1-415f-ac1f-911e31142bd9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:15.209798 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b49d332b-e5e1-415f-ac1f-911e31142bd9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:15.211372 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b49d332b-e5e1-415f-ac1f-911e31142bd9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:15.214965 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b49d332b-e5e1-415f-ac1f-911e31142bd9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:15.452482 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e51e840a-0fb1-41c2-9755-064e2878b14a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.313329 Jul 18 10:48:15.457021 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 64/127] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 18 10:48:15 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-interface => generated 284 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:15.648228 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b49d332b-e5e1-415f-ac1f-911e31142bd9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:15.659027 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b49d332b-e5e1-415f-ac1f-911e31142bd9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:15.665010 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b49d332b-e5e1-415f-ac1f-911e31142bd9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:15.666149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b49d332b-e5e1-415f-ac1f-911e31142bd9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1407 microversion: 2.20 time: 0.473750 Jul 18 10:48:15.667211 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 64/128] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:15 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1407 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:16.066291 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f1802136-d043-4410-b276-c1e75073d7d7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:16.067358 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f1802136-d043-4410-b276-c1e75073d7d7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:16.074824 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f1802136-d043-4410-b276-c1e75073d7d7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:16.075374 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f1802136-d043-4410-b276-c1e75073d7d7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:16.076271 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f1802136-d043-4410-b276-c1e75073d7d7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:16.076932 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f1802136-d043-4410-b276-c1e75073d7d7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:16.349560 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f1802136-d043-4410-b276-c1e75073d7d7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:16.357628 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f1802136-d043-4410-b276-c1e75073d7d7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.298038 Jul 18 10:48:16.367892 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 65/129] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:16 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:16.686312 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-57063e5d-f554-44b4-b783-8d8bfe7a098e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:16.687720 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-57063e5d-f554-44b4-b783-8d8bfe7a098e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:16.702059 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-57063e5d-f554-44b4-b783-8d8bfe7a098e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:16.702531 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-57063e5d-f554-44b4-b783-8d8bfe7a098e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:16.706650 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-57063e5d-f554-44b4-b783-8d8bfe7a098e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:16.707933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-57063e5d-f554-44b4-b783-8d8bfe7a098e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:16.863515 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-57063e5d-f554-44b4-b783-8d8bfe7a098e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:16.874824 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-57063e5d-f554-44b4-b783-8d8bfe7a098e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:16.876328 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-57063e5d-f554-44b4-b783-8d8bfe7a098e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:16.878291 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-57063e5d-f554-44b4-b783-8d8bfe7a098e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1598 microversion: 2.20 time: 0.196327 Jul 18 10:48:16.892072 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 65/130] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:16 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1598 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:16.900924 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-cb710569-e460-4596-8407-51105a562fc5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:16.900924 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-cb710569-e460-4596-8407-51105a562fc5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:16.904086 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=100 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:16.919888 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cb710569-e460-4596-8407-51105a562fc5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:16.920325 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cb710569-e460-4596-8407-51105a562fc5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:16.920689 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-3fbca34d-0fbb-46df-9351-9f475f8b3402 req-11b39403-e1d2-4a5f-b9ae-914c289a0c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eadfa860-196c-4946-85a4-a9a2aed7c1b7", "tag": "dce7face-5f9b-40f7-8b3c-e6b845457a5e"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:16.921478 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cb710569-e460-4596-8407-51105a562fc5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:16.922054 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cb710569-e460-4596-8407-51105a562fc5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:16.931841 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-3fbca34d-0fbb-46df-9351-9f475f8b3402 req-11b39403-e1d2-4a5f-b9ae-914c289a0c3d service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:16.932580 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-3fbca34d-0fbb-46df-9351-9f475f8b3402 req-11b39403-e1d2-4a5f-b9ae-914c289a0c3d service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:16.950440 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-3fbca34d-0fbb-46df-9351-9f475f8b3402 req-11b39403-e1d2-4a5f-b9ae-914c289a0c3d service nova] Creating event network-changed:dce7face-5f9b-40f7-8b3c-e6b845457a5e for instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 on hv-cinder-84949 Jul 18 10:48:16.957386 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-3fbca34d-0fbb-46df-9351-9f475f8b3402 req-11b39403-e1d2-4a5f-b9ae-914c289a0c3d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041040 Jul 18 10:48:16.959027 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 66/131] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:48:17.062857 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-cb710569-e460-4596-8407-51105a562fc5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.167773 Jul 18 10:48:17.063466 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 66/132] 10.222.0.49 () {60 vars in 1315 bytes} [Mon Jul 18 10:48:16 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:48:17.375922 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d8c8da9b-3817-4870-82bd-b12728835cb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:17.377056 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d8c8da9b-3817-4870-82bd-b12728835cb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:17.390536 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d8c8da9b-3817-4870-82bd-b12728835cb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:17.391877 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d8c8da9b-3817-4870-82bd-b12728835cb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:17.395900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d8c8da9b-3817-4870-82bd-b12728835cb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:17.396805 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d8c8da9b-3817-4870-82bd-b12728835cb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:18.010045 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d8c8da9b-3817-4870-82bd-b12728835cb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:18.038087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d8c8da9b-3817-4870-82bd-b12728835cb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.666515 Jul 18 10:48:18.055017 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 67/133] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:17 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:19.076528 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9a4be9f6-6671-4565-a667-e7f3c0c4941b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:19.077575 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-9a4be9f6-6671-4565-a667-e7f3c0c4941b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:19.086407 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9a4be9f6-6671-4565-a667-e7f3c0c4941b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:19.087203 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9a4be9f6-6671-4565-a667-e7f3c0c4941b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:19.088418 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9a4be9f6-6671-4565-a667-e7f3c0c4941b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:19.088983 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9a4be9f6-6671-4565-a667-e7f3c0c4941b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:19.422514 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9a4be9f6-6671-4565-a667-e7f3c0c4941b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:19.432581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9a4be9f6-6671-4565-a667-e7f3c0c4941b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.359937 Jul 18 10:48:19.432726 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 67/134] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:19 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:19.726018 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-3f7463df-de1b-4f0a-b0e0-7885fd77908c req-cdf49836-9c01-4ef0-9ee2-92cce198d195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d05192-b009-41ab-861b-b66d0352d41e", "tag": "abd1fe5c-3f12-4f5e-a659-6f5e05dab0ae"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:19.736581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-3f7463df-de1b-4f0a-b0e0-7885fd77908c req-cdf49836-9c01-4ef0-9ee2-92cce198d195 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:19.751425 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-3f7463df-de1b-4f0a-b0e0-7885fd77908c req-cdf49836-9c01-4ef0-9ee2-92cce198d195 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:19.751425 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-3f7463df-de1b-4f0a-b0e0-7885fd77908c req-cdf49836-9c01-4ef0-9ee2-92cce198d195 service nova] Creating event network-changed:abd1fe5c-3f12-4f5e-a659-6f5e05dab0ae for instance 14d05192-b009-41ab-861b-b66d0352d41e on hv-cinder-84949 Jul 18 10:48:19.754825 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-3f7463df-de1b-4f0a-b0e0-7885fd77908c req-cdf49836-9c01-4ef0-9ee2-92cce198d195 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034148 Jul 18 10:48:19.755448 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 68/135] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:20.456870 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-29ff9871-a96f-469b-8803-3e1610aa596e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:20.458123 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-29ff9871-a96f-469b-8803-3e1610aa596e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:20.472508 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-29ff9871-a96f-469b-8803-3e1610aa596e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:20.474313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-29ff9871-a96f-469b-8803-3e1610aa596e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:20.476390 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-29ff9871-a96f-469b-8803-3e1610aa596e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:20.477266 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-29ff9871-a96f-469b-8803-3e1610aa596e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:20.749170 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-29ff9871-a96f-469b-8803-3e1610aa596e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:20.758082 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-29ff9871-a96f-469b-8803-3e1610aa596e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.306236 Jul 18 10:48:20.758668 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 68/136] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:20 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:21.781622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3a13486d-d052-4533-94e0-e2b49884bdbd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:21.783653 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3a13486d-d052-4533-94e0-e2b49884bdbd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:21.795015 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3a13486d-d052-4533-94e0-e2b49884bdbd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:21.796252 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3a13486d-d052-4533-94e0-e2b49884bdbd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:21.797519 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3a13486d-d052-4533-94e0-e2b49884bdbd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:21.798159 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3a13486d-d052-4533-94e0-e2b49884bdbd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:22.249341 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3a13486d-d052-4533-94e0-e2b49884bdbd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:22.259723 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3a13486d-d052-4533-94e0-e2b49884bdbd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.484307 Jul 18 10:48:22.269772 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 69/137] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:21 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:23.277480 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-0a36aac1-3012-4569-bf42-6a8003cb9086 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:23.279780 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-0a36aac1-3012-4569-bf42-6a8003cb9086 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:23.297368 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0a36aac1-3012-4569-bf42-6a8003cb9086 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:23.297805 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0a36aac1-3012-4569-bf42-6a8003cb9086 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:23.301221 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0a36aac1-3012-4569-bf42-6a8003cb9086 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:23.301669 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0a36aac1-3012-4569-bf42-6a8003cb9086 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:23.318075 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=100 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:23.488529 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0a36aac1-3012-4569-bf42-6a8003cb9086 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:23.498252 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-0a36aac1-3012-4569-bf42-6a8003cb9086 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.225334 Jul 18 10:48:23.498855 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 69/138] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:23 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:24.515832 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-98c42ac9-2cb5-4803-a7e8-4dc82d8d9ac2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:24.516366 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-98c42ac9-2cb5-4803-a7e8-4dc82d8d9ac2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:24.524072 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-98c42ac9-2cb5-4803-a7e8-4dc82d8d9ac2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:24.524569 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-98c42ac9-2cb5-4803-a7e8-4dc82d8d9ac2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:24.525375 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-98c42ac9-2cb5-4803-a7e8-4dc82d8d9ac2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:24.525800 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-98c42ac9-2cb5-4803-a7e8-4dc82d8d9ac2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:24.669504 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-98c42ac9-2cb5-4803-a7e8-4dc82d8d9ac2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:24.672583 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:24.679127 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-98c42ac9-2cb5-4803-a7e8-4dc82d8d9ac2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.167092 Jul 18 10:48:24.679907 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 70/139] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:24 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:25.572505 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2af6bd71-444e-46b5-ae7f-1794322206de tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:25.573228 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2af6bd71-444e-46b5-ae7f-1794322206de tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:25.581548 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2af6bd71-444e-46b5-ae7f-1794322206de tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:25.582256 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2af6bd71-444e-46b5-ae7f-1794322206de tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:25.583036 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2af6bd71-444e-46b5-ae7f-1794322206de tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:25.583637 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2af6bd71-444e-46b5-ae7f-1794322206de tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:25.614609 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2af6bd71-444e-46b5-ae7f-1794322206de tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Going to try to terminate instance {{(pid=125005) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:48:25.698214 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6f1b06b1-970d-485c-b4ee-e1abd9f00548 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:25.699186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6f1b06b1-970d-485c-b4ee-e1abd9f00548 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:25.707438 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6f1b06b1-970d-485c-b4ee-e1abd9f00548 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:25.708164 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6f1b06b1-970d-485c-b4ee-e1abd9f00548 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:25.709009 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6f1b06b1-970d-485c-b4ee-e1abd9f00548 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:25.709452 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6f1b06b1-970d-485c-b4ee-e1abd9f00548 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:25.889348 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-6f1b06b1-970d-485c-b4ee-e1abd9f00548 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:25.903760 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6f1b06b1-970d-485c-b4ee-e1abd9f00548 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.210441 Jul 18 10:48:25.904491 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 71/140] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:25 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:26.045922 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2af6bd71-444e-46b5-ae7f-1794322206de tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "DELETE /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 204 len: 0 microversion: 2.1 time: 0.476706 Jul 18 10:48:26.047086 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 70/141] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:48:25 2022] DELETE /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:48:26.066551 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4f04a8b6-b847-4ec4-9f77-f165c6b76aa0 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:26.067166 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-4f04a8b6-b847-4ec4-9f77-f165c6b76aa0 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:26.077383 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4f04a8b6-b847-4ec4-9f77-f165c6b76aa0 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:26.077750 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4f04a8b6-b847-4ec4-9f77-f165c6b76aa0 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:26.078650 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4f04a8b6-b847-4ec4-9f77-f165c6b76aa0 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:26.080040 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4f04a8b6-b847-4ec4-9f77-f165c6b76aa0 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:26.256753 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-4f04a8b6-b847-4ec4-9f77-f165c6b76aa0 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:26.269503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4f04a8b6-b847-4ec4-9f77-f165c6b76aa0 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1554 microversion: 2.1 time: 0.210166 Jul 18 10:48:26.270498 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 72/142] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:26 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1554 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:26.922194 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-655219d5-6731-47b1-ad97-062b8191afe7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:26.922886 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-655219d5-6731-47b1-ad97-062b8191afe7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:26.932325 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-655219d5-6731-47b1-ad97-062b8191afe7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:26.932325 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-655219d5-6731-47b1-ad97-062b8191afe7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:26.932691 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-655219d5-6731-47b1-ad97-062b8191afe7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:26.933143 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-655219d5-6731-47b1-ad97-062b8191afe7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:27.100202 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-655219d5-6731-47b1-ad97-062b8191afe7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:27.109445 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-655219d5-6731-47b1-ad97-062b8191afe7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.191599 Jul 18 10:48:27.110155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 71/143] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:26 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:27.295914 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e7e65fa4-7a49-4acc-9be8-130929ee771f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:27.296586 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-e7e65fa4-7a49-4acc-9be8-130929ee771f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:27.304887 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e7e65fa4-7a49-4acc-9be8-130929ee771f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:27.305330 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e7e65fa4-7a49-4acc-9be8-130929ee771f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:27.306311 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e7e65fa4-7a49-4acc-9be8-130929ee771f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:27.306750 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e7e65fa4-7a49-4acc-9be8-130929ee771f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:27.486625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e7e65fa4-7a49-4acc-9be8-130929ee771f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:27.498588 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e7e65fa4-7a49-4acc-9be8-130929ee771f tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1554 microversion: 2.1 time: 0.203264 Jul 18 10:48:27.498588 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 73/144] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:27 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1554 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:28.129358 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c9f262e2-7e2b-4aa4-9369-546da75cf799 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:28.129358 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c9f262e2-7e2b-4aa4-9369-546da75cf799 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:28.136467 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c9f262e2-7e2b-4aa4-9369-546da75cf799 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:28.137247 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c9f262e2-7e2b-4aa4-9369-546da75cf799 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:28.138326 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c9f262e2-7e2b-4aa4-9369-546da75cf799 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:28.138733 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c9f262e2-7e2b-4aa4-9369-546da75cf799 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:28.295210 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c9f262e2-7e2b-4aa4-9369-546da75cf799 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:28.310538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c9f262e2-7e2b-4aa4-9369-546da75cf799 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.186142 Jul 18 10:48:28.311638 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 72/145] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:28 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:28.512921 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-36b3b491-7363-44b8-b3a1-e5a3d0f565c8 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:28.513522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-36b3b491-7363-44b8-b3a1-e5a3d0f565c8 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:28.521513 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-36b3b491-7363-44b8-b3a1-e5a3d0f565c8 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:28.522209 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-36b3b491-7363-44b8-b3a1-e5a3d0f565c8 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:28.529391 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-36b3b491-7363-44b8-b3a1-e5a3d0f565c8 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:28.529391 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-36b3b491-7363-44b8-b3a1-e5a3d0f565c8 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:28.786503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-36b3b491-7363-44b8-b3a1-e5a3d0f565c8 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:28.802895 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-36b3b491-7363-44b8-b3a1-e5a3d0f565c8 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1554 microversion: 2.1 time: 0.287508 Jul 18 10:48:28.803106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 74/146] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:28 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1554 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:29.275643 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-2a59f1de-46b1-4018-a9b3-4aa60a36dd77 req-cb9544b5-477e-4218-a6b9-2170897ec658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448b223d-269c-44ab-9fb8-01e1f863ee49", "name": "network-vif-deleted", "tag": "a660016a-47a5-4610-b64d-eed8b0819a10"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:29.291601 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-2a59f1de-46b1-4018-a9b3-4aa60a36dd77 req-cb9544b5-477e-4218-a6b9-2170897ec658 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:29.292049 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-2a59f1de-46b1-4018-a9b3-4aa60a36dd77 req-cb9544b5-477e-4218-a6b9-2170897ec658 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:29.305914 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-2a59f1de-46b1-4018-a9b3-4aa60a36dd77 req-cb9544b5-477e-4218-a6b9-2170897ec658 service nova] Creating event network-vif-deleted:a660016a-47a5-4610-b64d-eed8b0819a10 for instance 448b223d-269c-44ab-9fb8-01e1f863ee49 on hv-cinder-84949 Jul 18 10:48:29.312250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-2a59f1de-46b1-4018-a9b3-4aa60a36dd77 req-cb9544b5-477e-4218-a6b9-2170897ec658 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044878 Jul 18 10:48:29.313693 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 73/147] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:29.336293 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-69f2709d-fb16-4ee7-862d-18196e858a9a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:29.337532 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-69f2709d-fb16-4ee7-862d-18196e858a9a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:29.344098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-69f2709d-fb16-4ee7-862d-18196e858a9a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:29.344470 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-69f2709d-fb16-4ee7-862d-18196e858a9a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:29.346044 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-69f2709d-fb16-4ee7-862d-18196e858a9a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:29.347019 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-69f2709d-fb16-4ee7-862d-18196e858a9a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:29.518767 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-69f2709d-fb16-4ee7-862d-18196e858a9a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:29.529939 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-69f2709d-fb16-4ee7-862d-18196e858a9a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.195642 Jul 18 10:48:29.529939 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 75/148] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:29 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:29.820023 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-69a86518-d807-4382-9f0b-e0d4d2703f31 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:29.821407 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-69a86518-d807-4382-9f0b-e0d4d2703f31 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:29.832841 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-69a86518-d807-4382-9f0b-e0d4d2703f31 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:29.833827 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-69a86518-d807-4382-9f0b-e0d4d2703f31 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:29.834858 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-69a86518-d807-4382-9f0b-e0d4d2703f31 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:29.835339 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-69a86518-d807-4382-9f0b-e0d4d2703f31 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:29.922988 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-69a86518-d807-4382-9f0b-e0d4d2703f31 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:29.938721 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-69a86518-d807-4382-9f0b-e0d4d2703f31 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1345 microversion: 2.1 time: 0.126419 Jul 18 10:48:29.939796 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 74/149] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:29 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:30.548561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2a01bcb2-1240-4e55-a65e-3245dd189225 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:30.549912 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2a01bcb2-1240-4e55-a65e-3245dd189225 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:30.566231 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2a01bcb2-1240-4e55-a65e-3245dd189225 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:30.571636 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2a01bcb2-1240-4e55-a65e-3245dd189225 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:30.571636 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2a01bcb2-1240-4e55-a65e-3245dd189225 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:30.571636 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2a01bcb2-1240-4e55-a65e-3245dd189225 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:30.797329 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2a01bcb2-1240-4e55-a65e-3245dd189225 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:30.810968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2a01bcb2-1240-4e55-a65e-3245dd189225 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.268199 Jul 18 10:48:30.811872 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 76/150] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:30 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:30.961614 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7eeb9f88-6846-47f5-b0b8-b16ac5930373 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:30.962642 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-7eeb9f88-6846-47f5-b0b8-b16ac5930373 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:30.970303 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7eeb9f88-6846-47f5-b0b8-b16ac5930373 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:30.970773 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7eeb9f88-6846-47f5-b0b8-b16ac5930373 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:30.971835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7eeb9f88-6846-47f5-b0b8-b16ac5930373 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:30.972273 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7eeb9f88-6846-47f5-b0b8-b16ac5930373 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:31.010867 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7eeb9f88-6846-47f5-b0b8-b16ac5930373 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:31.011312 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7eeb9f88-6846-47f5-b0b8-b16ac5930373 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:31.012305 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-7eeb9f88-6846-47f5-b0b8-b16ac5930373 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lazy-loading 'fault' on Instance uuid 448b223d-269c-44ab-9fb8-01e1f863ee49 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:48:31.080148 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7eeb9f88-6846-47f5-b0b8-b16ac5930373 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce15ddb712fa42dc8d487fe22d0959bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d288974aac54fa681cfafa262d019eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:31.095687 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7eeb9f88-6846-47f5-b0b8-b16ac5930373 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 200 len: 1350 microversion: 2.1 time: 0.138648 Jul 18 10:48:31.097078 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 75/151] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:30 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 1350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:31.836451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b51a51ae-6c8f-44b7-be5b-1b643e3375bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:31.837955 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b51a51ae-6c8f-44b7-be5b-1b643e3375bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:31.847600 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b51a51ae-6c8f-44b7-be5b-1b643e3375bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:31.848582 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b51a51ae-6c8f-44b7-be5b-1b643e3375bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:31.850623 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b51a51ae-6c8f-44b7-be5b-1b643e3375bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:31.851737 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b51a51ae-6c8f-44b7-be5b-1b643e3375bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:32.051195 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b51a51ae-6c8f-44b7-be5b-1b643e3375bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:32.059940 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b51a51ae-6c8f-44b7-be5b-1b643e3375bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.230072 Jul 18 10:48:32.060635 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 77/152] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:31 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:32.119125 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a485f512-ec08-4d08-848a-605fb8bfa763 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:32.122213 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a485f512-ec08-4d08-848a-605fb8bfa763 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:32.126240 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a485f512-ec08-4d08-848a-605fb8bfa763 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:32.131410 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a485f512-ec08-4d08-848a-605fb8bfa763 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:32.131410 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a485f512-ec08-4d08-848a-605fb8bfa763 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:32.131410 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a485f512-ec08-4d08-848a-605fb8bfa763 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:32.146577 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-a485f512-ec08-4d08-848a-605fb8bfa763 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] HTTP exception thrown: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a485f512-ec08-4d08-848a-605fb8bfa763 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Request method failure captured: Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 HTTP/1.1 Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1To6zf14A2j7v_8ZTv8DYvyh5wUoXffJePjLbo2vFA8MXAbtt1HPNnSw4EVRg1jA1Dn-E4VrfEJJ7FGdIMVttsnorThezAWMdPisJ-gSfBEP6p5u6BJEpOTafovu0VidGcxtvNaj8dydrR4m9fwIIu7DDM3EVbmx4cEYgdlJME7erMk Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 6d288974aac54fa681cfafa262d019eb Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-DeleteServersTestJSON-635289930 Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:48:32.151563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:48:32.153019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d288974aac54fa681cfafa262d019eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6d288974aac54fa681cfafa262d019eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d288974aac54fa681cfafa262d019eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6d288974aac54fa681cfafa262d019eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:48:32.153019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-DeleteServersTestJSON-635289930 Jul 18 10:48:32.153019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 6d288974aac54fa681cfafa262d019eb Jul 18 10:48:32.153019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-DeleteServersTestJSON-635289930 Jul 18 10:48:32.153019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-DeleteServersTestJSON-635289930-project Jul 18 10:48:32.153019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:48:32.153019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:48:32.153019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: ce15ddb712fa42dc8d487fe22d0959bd Jul 18 10:48:32.153019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-DeleteServersTestJSON-635289930-project Jul 18 10:48:32.153019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:48:32.153019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:32.153019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '448b223d-269c-44ab-9fb8-01e1f863ee49'} Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:48:32.158018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:32.161385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:48:32.163408 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a485f512-ec08-4d08-848a-605fb8bfa763 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Returning 404 to user: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:48:32.163408 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a485f512-ec08-4d08-848a-605fb8bfa763 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 404 len: 111 microversion: 2.1 time: 0.037852 Jul 18 10:48:32.163408 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 76/153] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:32 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:48:32.312650 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a41c38dc-0a1f-44b4-b044-61cd4d49bfe2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:32.313601 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a41c38dc-0a1f-44b4-b044-61cd4d49bfe2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:32.322241 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a41c38dc-0a1f-44b4-b044-61cd4d49bfe2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:32.322681 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a41c38dc-0a1f-44b4-b044-61cd4d49bfe2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:32.323462 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a41c38dc-0a1f-44b4-b044-61cd4d49bfe2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:32.323891 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a41c38dc-0a1f-44b4-b044-61cd4d49bfe2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:32.338910 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-a41c38dc-0a1f-44b4-b044-61cd4d49bfe2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] HTTP exception thrown: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a41c38dc-0a1f-44b4-b044-61cd4d49bfe2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Request method failure captured: Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49/os-volume_attachments HTTP/1.1 Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To6zf14A2j7v_8ZTv8DYvyh5wUoXffJePjLbo2vFA8MXAbtt1HPNnSw4EVRg1jA1Dn-E4VrfEJJ7FGdIMVttsnorThezAWMdPisJ-gSfBEP6p5u6BJEpOTafovu0VidGcxtvNaj8dydrR4m9fwIIu7DDM3EVbmx4cEYgdlJME7erMk Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 6d288974aac54fa681cfafa262d019eb Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-DeleteServersTestJSON-635289930 Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:48:32.343864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:48:32.347007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d288974aac54fa681cfafa262d019eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6d288974aac54fa681cfafa262d019eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d288974aac54fa681cfafa262d019eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6d288974aac54fa681cfafa262d019eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:48:32.347007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-DeleteServersTestJSON-635289930 Jul 18 10:48:32.347007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 6d288974aac54fa681cfafa262d019eb Jul 18 10:48:32.347007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-DeleteServersTestJSON-635289930 Jul 18 10:48:32.347007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-DeleteServersTestJSON-635289930-project Jul 18 10:48:32.347007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:48:32.347007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:48:32.347007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: ce15ddb712fa42dc8d487fe22d0959bd Jul 18 10:48:32.347007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-DeleteServersTestJSON-635289930-project Jul 18 10:48:32.347007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:48:32.347007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:32.347007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'server_id': '448b223d-269c-44ab-9fb8-01e1f863ee49'} Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:48:32.348262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:32.351094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:48:32.353006 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a41c38dc-0a1f-44b4-b044-61cd4d49bfe2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Returning 404 to user: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:48:32.353006 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a41c38dc-0a1f-44b4-b044-61cd4d49bfe2 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037378 Jul 18 10:48:32.353006 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 78/154] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:48:32 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:48:33.086407 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c47c5208-03a1-4632-8b3d-4376e016e1dc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:33.086917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c47c5208-03a1-4632-8b3d-4376e016e1dc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:33.097609 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c47c5208-03a1-4632-8b3d-4376e016e1dc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:33.103404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c47c5208-03a1-4632-8b3d-4376e016e1dc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:33.103404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c47c5208-03a1-4632-8b3d-4376e016e1dc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:33.103404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c47c5208-03a1-4632-8b3d-4376e016e1dc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:33.263625 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c47c5208-03a1-4632-8b3d-4376e016e1dc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:33.275957 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c47c5208-03a1-4632-8b3d-4376e016e1dc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.193765 Jul 18 10:48:33.276563 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 77/155] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:33 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:34.099078 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a4fcc0c0-f38c-469f-ab37-ea30aa5e3573 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:34.100923 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a4fcc0c0-f38c-469f-ab37-ea30aa5e3573 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:34.118904 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a4fcc0c0-f38c-469f-ab37-ea30aa5e3573 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:34.119700 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a4fcc0c0-f38c-469f-ab37-ea30aa5e3573 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:34.121229 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a4fcc0c0-f38c-469f-ab37-ea30aa5e3573 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:34.122025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a4fcc0c0-f38c-469f-ab37-ea30aa5e3573 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:34.151670 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-a4fcc0c0-f38c-469f-ab37-ea30aa5e3573 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] HTTP exception thrown: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a4fcc0c0-f38c-469f-ab37-ea30aa5e3573 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Request method failure captured: Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: DELETE /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 HTTP/1.1 Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To6zf14A2j7v_8ZTv8DYvyh5wUoXffJePjLbo2vFA8MXAbtt1HPNnSw4EVRg1jA1Dn-E4VrfEJJ7FGdIMVttsnorThezAWMdPisJ-gSfBEP6p5u6BJEpOTafovu0VidGcxtvNaj8dydrR4m9fwIIu7DDM3EVbmx4cEYgdlJME7erMk Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 6d288974aac54fa681cfafa262d019eb Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-DeleteServersTestJSON-635289930 Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:48:34.156442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:48:34.158404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d288974aac54fa681cfafa262d019eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6d288974aac54fa681cfafa262d019eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d288974aac54fa681cfafa262d019eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6d288974aac54fa681cfafa262d019eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:48:34.158404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-DeleteServersTestJSON-635289930 Jul 18 10:48:34.158404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 6d288974aac54fa681cfafa262d019eb Jul 18 10:48:34.158404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-DeleteServersTestJSON-635289930 Jul 18 10:48:34.158404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-DeleteServersTestJSON-635289930-project Jul 18 10:48:34.158404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:48:34.158404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:48:34.158404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: ce15ddb712fa42dc8d487fe22d0959bd Jul 18 10:48:34.158404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-DeleteServersTestJSON-635289930-project Jul 18 10:48:34.158404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:48:34.158404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:34.158404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '448b223d-269c-44ab-9fb8-01e1f863ee49'} Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:48:34.159048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:34.160064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:48:34.161381 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a4fcc0c0-f38c-469f-ab37-ea30aa5e3573 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Returning 404 to user: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:48:34.161381 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a4fcc0c0-f38c-469f-ab37-ea30aa5e3573 tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "DELETE /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 404 len: 111 microversion: 2.1 time: 0.071558 Jul 18 10:48:34.164759 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 79/156] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:48:34 2022] DELETE /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:48:34.171058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-153d2680-0a9a-4aae-8165-3326bfe95a0b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:34.171687 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-153d2680-0a9a-4aae-8165-3326bfe95a0b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] [instance: 448b223d-269c-44ab-9fb8-01e1f863ee49] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:34.178556 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-153d2680-0a9a-4aae-8165-3326bfe95a0b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:34.179002 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-153d2680-0a9a-4aae-8165-3326bfe95a0b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:34.182840 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-153d2680-0a9a-4aae-8165-3326bfe95a0b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:34.182840 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-153d2680-0a9a-4aae-8165-3326bfe95a0b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:34.195274 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-153d2680-0a9a-4aae-8165-3326bfe95a0b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] HTTP exception thrown: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-153d2680-0a9a-4aae-8165-3326bfe95a0b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Request method failure captured: Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 HTTP/1.1 Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1To6zf14A2j7v_8ZTv8DYvyh5wUoXffJePjLbo2vFA8MXAbtt1HPNnSw4EVRg1jA1Dn-E4VrfEJJ7FGdIMVttsnorThezAWMdPisJ-gSfBEP6p5u6BJEpOTafovu0VidGcxtvNaj8dydrR4m9fwIIu7DDM3EVbmx4cEYgdlJME7erMk Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 6d288974aac54fa681cfafa262d019eb Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-DeleteServersTestJSON-635289930 Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:48:34.197058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:48:34.199284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d288974aac54fa681cfafa262d019eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6d288974aac54fa681cfafa262d019eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6d288974aac54fa681cfafa262d019eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6d288974aac54fa681cfafa262d019eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:48:34.199284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-DeleteServersTestJSON-635289930 Jul 18 10:48:34.199284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 6d288974aac54fa681cfafa262d019eb Jul 18 10:48:34.199284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-DeleteServersTestJSON-635289930 Jul 18 10:48:34.199284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-DeleteServersTestJSON-635289930-project Jul 18 10:48:34.199284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:48:34.199284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:48:34.199284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: ce15ddb712fa42dc8d487fe22d0959bd Jul 18 10:48:34.199284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-DeleteServersTestJSON-635289930-project Jul 18 10:48:34.199284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:48:34.199284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:34.199284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '448b223d-269c-44ab-9fb8-01e1f863ee49'} Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:48:34.200765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. Jul 18 10:48:34.202998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:48:34.204766 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-153d2680-0a9a-4aae-8165-3326bfe95a0b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] Returning 404 to user: Instance 448b223d-269c-44ab-9fb8-01e1f863ee49 could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:48:34.204766 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-153d2680-0a9a-4aae-8165-3326bfe95a0b tempest-DeleteServersTestJSON-635289930 tempest-DeleteServersTestJSON-635289930-project] 10.222.0.49 "GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49" status: 404 len: 111 microversion: 2.1 time: 0.031589 Jul 18 10:48:34.204766 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 78/157] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:34 2022] GET /compute/v2.1/servers/448b223d-269c-44ab-9fb8-01e1f863ee49 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:48:34.301393 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ef7fadbe-b51e-4990-876c-df827f30abd5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:34.302113 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ef7fadbe-b51e-4990-876c-df827f30abd5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:34.309856 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ef7fadbe-b51e-4990-876c-df827f30abd5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:34.310210 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ef7fadbe-b51e-4990-876c-df827f30abd5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:34.311068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ef7fadbe-b51e-4990-876c-df827f30abd5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:34.311573 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ef7fadbe-b51e-4990-876c-df827f30abd5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:34.546818 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ef7fadbe-b51e-4990-876c-df827f30abd5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:34.556972 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ef7fadbe-b51e-4990-876c-df827f30abd5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.259696 Jul 18 10:48:34.557573 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 80/158] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:34 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:35.583353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8db1f7d7-bded-4d3b-8584-cffc28f18ee3 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:35.584717 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8db1f7d7-bded-4d3b-8584-cffc28f18ee3 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:35.597769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8db1f7d7-bded-4d3b-8584-cffc28f18ee3 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:35.598693 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8db1f7d7-bded-4d3b-8584-cffc28f18ee3 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:35.600302 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8db1f7d7-bded-4d3b-8584-cffc28f18ee3 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:35.609453 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8db1f7d7-bded-4d3b-8584-cffc28f18ee3 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:35.822211 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8db1f7d7-bded-4d3b-8584-cffc28f18ee3 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:35.830949 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8db1f7d7-bded-4d3b-8584-cffc28f18ee3 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.255645 Jul 18 10:48:35.831529 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 79/159] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:35 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:36.861437 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9c6c87f6-83cb-4d02-a0d2-aef67137b641 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:36.863742 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9c6c87f6-83cb-4d02-a0d2-aef67137b641 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:36.880465 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9c6c87f6-83cb-4d02-a0d2-aef67137b641 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:36.882045 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9c6c87f6-83cb-4d02-a0d2-aef67137b641 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:36.883972 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9c6c87f6-83cb-4d02-a0d2-aef67137b641 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:36.885418 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9c6c87f6-83cb-4d02-a0d2-aef67137b641 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:37.145788 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9c6c87f6-83cb-4d02-a0d2-aef67137b641 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:37.159511 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9c6c87f6-83cb-4d02-a0d2-aef67137b641 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.307161 Jul 18 10:48:37.160819 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 81/160] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:36 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:38.198215 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b06b0d5b-2e1f-4493-a942-e78a692278ea tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:38.198959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b06b0d5b-2e1f-4493-a942-e78a692278ea tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:38.206600 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b06b0d5b-2e1f-4493-a942-e78a692278ea tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:38.207864 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b06b0d5b-2e1f-4493-a942-e78a692278ea tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:38.207864 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b06b0d5b-2e1f-4493-a942-e78a692278ea tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:38.208196 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b06b0d5b-2e1f-4493-a942-e78a692278ea tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:38.543492 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-b06b0d5b-2e1f-4493-a942-e78a692278ea tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:38.567369 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b06b0d5b-2e1f-4493-a942-e78a692278ea tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.383245 Jul 18 10:48:38.567862 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 80/161] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:38 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:39.585149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5022649b-9c4d-4b25-804b-6042e3b40da2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:39.586561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-5022649b-9c4d-4b25-804b-6042e3b40da2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:39.593719 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5022649b-9c4d-4b25-804b-6042e3b40da2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:39.594462 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5022649b-9c4d-4b25-804b-6042e3b40da2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:39.596616 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5022649b-9c4d-4b25-804b-6042e3b40da2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:39.597593 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5022649b-9c4d-4b25-804b-6042e3b40da2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:39.784813 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-5022649b-9c4d-4b25-804b-6042e3b40da2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:39.802071 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5022649b-9c4d-4b25-804b-6042e3b40da2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.220598 Jul 18 10:48:39.803112 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 82/162] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:39 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:40.821365 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e74dd05c-f10a-4428-8c2c-345c3cc865eb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:40.822034 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e74dd05c-f10a-4428-8c2c-345c3cc865eb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:40.829415 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e74dd05c-f10a-4428-8c2c-345c3cc865eb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:40.829951 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e74dd05c-f10a-4428-8c2c-345c3cc865eb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:40.830770 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e74dd05c-f10a-4428-8c2c-345c3cc865eb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:40.831832 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e74dd05c-f10a-4428-8c2c-345c3cc865eb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:41.020082 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e74dd05c-f10a-4428-8c2c-345c3cc865eb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:41.028454 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e74dd05c-f10a-4428-8c2c-345c3cc865eb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.211256 Jul 18 10:48:41.029093 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 81/163] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:40 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:42.046478 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-74a0d2f4-6ef1-40d7-918f-fd0e29bd9ca2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:42.047725 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-74a0d2f4-6ef1-40d7-918f-fd0e29bd9ca2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:42.053838 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-74a0d2f4-6ef1-40d7-918f-fd0e29bd9ca2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:42.054173 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-74a0d2f4-6ef1-40d7-918f-fd0e29bd9ca2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:42.054956 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-74a0d2f4-6ef1-40d7-918f-fd0e29bd9ca2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:42.055365 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-74a0d2f4-6ef1-40d7-918f-fd0e29bd9ca2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:42.215331 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-74a0d2f4-6ef1-40d7-918f-fd0e29bd9ca2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:42.225175 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-74a0d2f4-6ef1-40d7-918f-fd0e29bd9ca2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.182608 Jul 18 10:48:42.225935 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 83/164] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:42 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:43.244044 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e5718f8a-27f9-4eb5-b437-da678ee27a54 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:43.244812 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e5718f8a-27f9-4eb5-b437-da678ee27a54 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:43.251881 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e5718f8a-27f9-4eb5-b437-da678ee27a54 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:43.252511 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e5718f8a-27f9-4eb5-b437-da678ee27a54 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:43.253708 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e5718f8a-27f9-4eb5-b437-da678ee27a54 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:43.254247 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e5718f8a-27f9-4eb5-b437-da678ee27a54 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:43.497494 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e5718f8a-27f9-4eb5-b437-da678ee27a54 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:43.506929 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e5718f8a-27f9-4eb5-b437-da678ee27a54 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.267569 Jul 18 10:48:43.507526 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 82/165] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:43 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:44.523977 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-02b98293-317b-445e-a63d-f6c5ffefe75e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:44.524612 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-02b98293-317b-445e-a63d-f6c5ffefe75e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:44.531011 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-02b98293-317b-445e-a63d-f6c5ffefe75e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:44.531484 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-02b98293-317b-445e-a63d-f6c5ffefe75e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:44.532318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-02b98293-317b-445e-a63d-f6c5ffefe75e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:44.532747 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-02b98293-317b-445e-a63d-f6c5ffefe75e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:44.678316 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-02b98293-317b-445e-a63d-f6c5ffefe75e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:44.690632 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-02b98293-317b-445e-a63d-f6c5ffefe75e tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.170783 Jul 18 10:48:44.691216 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 84/166] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:44 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:45.708569 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8eebb438-9eff-4bf6-8cf9-e3538ba1ebec tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:45.709220 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8eebb438-9eff-4bf6-8cf9-e3538ba1ebec tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:45.715675 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8eebb438-9eff-4bf6-8cf9-e3538ba1ebec tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:45.716121 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8eebb438-9eff-4bf6-8cf9-e3538ba1ebec tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:45.716899 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8eebb438-9eff-4bf6-8cf9-e3538ba1ebec tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:45.717330 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8eebb438-9eff-4bf6-8cf9-e3538ba1ebec tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:45.869254 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8eebb438-9eff-4bf6-8cf9-e3538ba1ebec tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:45.878718 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8eebb438-9eff-4bf6-8cf9-e3538ba1ebec tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.174811 Jul 18 10:48:45.879470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 83/167] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:45 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:46.902498 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-061b5e18-66b1-436a-8209-d45adf051f4f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:46.906982 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-061b5e18-66b1-436a-8209-d45adf051f4f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:46.908425 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=49 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:46.913133 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-061b5e18-66b1-436a-8209-d45adf051f4f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:46.913963 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-061b5e18-66b1-436a-8209-d45adf051f4f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:46.915149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-061b5e18-66b1-436a-8209-d45adf051f4f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:46.915781 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-061b5e18-66b1-436a-8209-d45adf051f4f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:47.072464 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-061b5e18-66b1-436a-8209-d45adf051f4f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:47.084162 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-061b5e18-66b1-436a-8209-d45adf051f4f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1521 microversion: 2.1 time: 0.188642 Jul 18 10:48:47.085281 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 85/168] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:46 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:48.102195 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a4bb6ee9-cb4a-4068-b4b1-837aae3295e1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:48.102790 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a4bb6ee9-cb4a-4068-b4b1-837aae3295e1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:48.108977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4bb6ee9-cb4a-4068-b4b1-837aae3295e1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:48.109417 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4bb6ee9-cb4a-4068-b4b1-837aae3295e1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:48.110904 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4bb6ee9-cb4a-4068-b4b1-837aae3295e1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:48.111331 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4bb6ee9-cb4a-4068-b4b1-837aae3295e1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:48.310301 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a4bb6ee9-cb4a-4068-b4b1-837aae3295e1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:48.318932 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a4bb6ee9-cb4a-4068-b4b1-837aae3295e1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1501 microversion: 2.1 time: 0.220394 Jul 18 10:48:48.319516 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 84/169] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:48 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1501 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:48.337681 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-cdf217f2-30d4-4049-b2bc-6e1c2e175971 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:48.338967 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-cdf217f2-30d4-4049-b2bc-6e1c2e175971 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:48.346696 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cdf217f2-30d4-4049-b2bc-6e1c2e175971 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:48.347135 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cdf217f2-30d4-4049-b2bc-6e1c2e175971 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:48.347965 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cdf217f2-30d4-4049-b2bc-6e1c2e175971 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:48.348560 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cdf217f2-30d4-4049-b2bc-6e1c2e175971 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:48.581169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-cdf217f2-30d4-4049-b2bc-6e1c2e175971 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:48.589254 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-cdf217f2-30d4-4049-b2bc-6e1c2e175971 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1515 microversion: 2.1 time: 0.256012 Jul 18 10:48:48.589908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 86/170] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:48 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:50.612251 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a4393fe7-4e8a-4e80-a728-dbc4d47cba73 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:50.613709 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a4393fe7-4e8a-4e80-a728-dbc4d47cba73 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:50.624565 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:50.624565 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4393fe7-4e8a-4e80-a728-dbc4d47cba73 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:50.624565 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4393fe7-4e8a-4e80-a728-dbc4d47cba73 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:50.624565 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4393fe7-4e8a-4e80-a728-dbc4d47cba73 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:50.625083 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4393fe7-4e8a-4e80-a728-dbc4d47cba73 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:50.649601 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-a4393fe7-4e8a-4e80-a728-dbc4d47cba73 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lazy-loading 'flavor' on Instance uuid 4728713a-e4cd-4e09-b104-7a57de4f2242 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:48:50.702900 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:51.201476 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a4393fe7-4e8a-4e80-a728-dbc4d47cba73 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "POST /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242/action" status: 200 len: 32 microversion: 2.1 time: 0.592412 Jul 18 10:48:51.201476 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 85/171] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 18 10:48:50 2022] POST /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242/action => generated 32 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:48:51.210952 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d6bec949-f213-4257-b88b-ad4817041b6d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:51.211566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d6bec949-f213-4257-b88b-ad4817041b6d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:51.222215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6bec949-f213-4257-b88b-ad4817041b6d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:51.222215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6bec949-f213-4257-b88b-ad4817041b6d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:51.222215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6bec949-f213-4257-b88b-ad4817041b6d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:51.222215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6bec949-f213-4257-b88b-ad4817041b6d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:51.357575 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d6bec949-f213-4257-b88b-ad4817041b6d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:51.366834 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d6bec949-f213-4257-b88b-ad4817041b6d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.159717 Jul 18 10:48:51.367414 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 87/172] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:51 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:51.683953 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1010070302", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "networks": [{"uuid": "68c9cc30-3e35-4ed5-8849-6c07232ca4ed"}]}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:51.746598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.network.neutron [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] validate_networks() for [('68c9cc30-3e35-4ed5-8849-6c07232ca4ed', None, None, None, None, None)] {{(pid=125005) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:48:52.398894 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-1d3406c5-8560-41b8-9bba-c23b48140f18 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:52.399650 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-1d3406c5-8560-41b8-9bba-c23b48140f18 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:52.407067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1d3406c5-8560-41b8-9bba-c23b48140f18 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:52.407581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1d3406c5-8560-41b8-9bba-c23b48140f18 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:52.408436 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1d3406c5-8560-41b8-9bba-c23b48140f18 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:52.409121 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1d3406c5-8560-41b8-9bba-c23b48140f18 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:52.437427 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Flavor limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:48:52.439952 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Image limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:48:52.439952 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Flavor pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:48:52.439952 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Image pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:48:52.439952 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:48:52.450483 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:52.450884 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:52.451667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:52.452090 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:52.473772 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Getting quotas for project e8ea247cf5a540768bbbc7260b74f11c. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:48:52.478623 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Getting quotas for user 49e86a3f10b64ef38664013e197782c3 and project e8ea247cf5a540768bbbc7260b74f11c. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:48:52.494637 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Going to run 1 instances... {{(pid=125005) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:48:52.497701 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125005) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:48:52.587448 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-1d3406c5-8560-41b8-9bba-c23b48140f18 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:52.594132 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=100 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:52.600600 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-1d3406c5-8560-41b8-9bba-c23b48140f18 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.205448 Jul 18 10:48:52.601439 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 88/173] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:52 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:52.710846 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8d482fc1-f9b4-48e2-a7b6-ce5d56150bbc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031281 Jul 18 10:48:52.717599 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 86/174] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:48:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:48:52.725484 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-aa17a89d-0ca1-4f87-a12d-677420ec0d2d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:52.726346 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-aa17a89d-0ca1-4f87-a12d-677420ec0d2d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:52.792746 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-aa17a89d-0ca1-4f87-a12d-677420ec0d2d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:52.806994 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-aa17a89d-0ca1-4f87-a12d-677420ec0d2d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1214 microversion: 2.1 time: 0.087041 Jul 18 10:48:52.813978 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 89/175] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:52 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:53.627186 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-03eb4547-8a5a-402d-938a-67a2c040424a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:53.627865 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-03eb4547-8a5a-402d-938a-67a2c040424a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:53.635880 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-03eb4547-8a5a-402d-938a-67a2c040424a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:53.636255 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-03eb4547-8a5a-402d-938a-67a2c040424a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:53.637058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-03eb4547-8a5a-402d-938a-67a2c040424a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:53.637489 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-03eb4547-8a5a-402d-938a-67a2c040424a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:53.826468 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-bf7134cf-cb1f-4d98-90df-53f31eb32e98 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:53.829455 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-bf7134cf-cb1f-4d98-90df-53f31eb32e98 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:53.834858 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-03eb4547-8a5a-402d-938a-67a2c040424a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:53.842457 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-03eb4547-8a5a-402d-938a-67a2c040424a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.219403 Jul 18 10:48:53.843027 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 87/176] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:53 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:53.885267 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-bf7134cf-cb1f-4d98-90df-53f31eb32e98 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:53.894283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-bf7134cf-cb1f-4d98-90df-53f31eb32e98 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1214 microversion: 2.1 time: 0.071700 Jul 18 10:48:53.894771 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 90/177] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:53 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:54.859866 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8e701818-79d3-439e-a86d-0fc18783b3d1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:54.861381 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8e701818-79d3-439e-a86d-0fc18783b3d1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:54.868571 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8e701818-79d3-439e-a86d-0fc18783b3d1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:54.869041 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8e701818-79d3-439e-a86d-0fc18783b3d1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:54.869860 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8e701818-79d3-439e-a86d-0fc18783b3d1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:54.870284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8e701818-79d3-439e-a86d-0fc18783b3d1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:54.918072 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-43065edc-3363-4d49-8591-1a2f7a410511 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:54.918072 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-43065edc-3363-4d49-8591-1a2f7a410511 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:54.927360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-43065edc-3363-4d49-8591-1a2f7a410511 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:54.927849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-43065edc-3363-4d49-8591-1a2f7a410511 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:54.928653 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-43065edc-3363-4d49-8591-1a2f7a410511 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:54.929127 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-43065edc-3363-4d49-8591-1a2f7a410511 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:55.005502 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-43065edc-3363-4d49-8591-1a2f7a410511 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:55.015942 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-43065edc-3363-4d49-8591-1a2f7a410511 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1218 microversion: 2.1 time: 0.106863 Jul 18 10:48:55.018668 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 91/178] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:54 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:55.041257 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8e701818-79d3-439e-a86d-0fc18783b3d1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:55.049387 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8e701818-79d3-439e-a86d-0fc18783b3d1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.193328 Jul 18 10:48:55.049975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 88/179] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:54 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:56.035867 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a3e0b7cc-f899-4e8f-bf1c-cd2629984761 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:56.036622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a3e0b7cc-f899-4e8f-bf1c-cd2629984761 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:56.043459 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a3e0b7cc-f899-4e8f-bf1c-cd2629984761 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:56.043908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a3e0b7cc-f899-4e8f-bf1c-cd2629984761 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:56.044668 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a3e0b7cc-f899-4e8f-bf1c-cd2629984761 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:56.045140 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a3e0b7cc-f899-4e8f-bf1c-cd2629984761 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:56.066722 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-914ade53-3ec8-4543-acb5-cbe47da5bbbf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:56.067338 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-914ade53-3ec8-4543-acb5-cbe47da5bbbf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:56.073885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-914ade53-3ec8-4543-acb5-cbe47da5bbbf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:56.074345 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-914ade53-3ec8-4543-acb5-cbe47da5bbbf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:56.075110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-914ade53-3ec8-4543-acb5-cbe47da5bbbf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:56.075674 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-914ade53-3ec8-4543-acb5-cbe47da5bbbf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:56.119860 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a3e0b7cc-f899-4e8f-bf1c-cd2629984761 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:56.128936 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a3e0b7cc-f899-4e8f-bf1c-cd2629984761 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1218 microversion: 2.1 time: 0.097326 Jul 18 10:48:56.129526 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 92/180] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:56 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:56.230996 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-914ade53-3ec8-4543-acb5-cbe47da5bbbf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:56.239626 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-914ade53-3ec8-4543-acb5-cbe47da5bbbf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.176869 Jul 18 10:48:56.240199 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 89/181] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:56 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:57.146694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8e760bec-06fb-42a1-aee1-93705dd60c6d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:57.147292 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-8e760bec-06fb-42a1-aee1-93705dd60c6d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:57.154441 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8e760bec-06fb-42a1-aee1-93705dd60c6d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:57.154889 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8e760bec-06fb-42a1-aee1-93705dd60c6d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:57.155988 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8e760bec-06fb-42a1-aee1-93705dd60c6d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:57.157281 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8e760bec-06fb-42a1-aee1-93705dd60c6d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:57.231964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-8e760bec-06fb-42a1-aee1-93705dd60c6d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:57.240118 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-8e760bec-06fb-42a1-aee1-93705dd60c6d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1266 microversion: 2.1 time: 0.097408 Jul 18 10:48:57.240831 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 93/182] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:57 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:57.255960 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7af71048-dd51-49a3-9f88-54d2de0b248a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:57.256565 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-7af71048-dd51-49a3-9f88-54d2de0b248a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:57.262938 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7af71048-dd51-49a3-9f88-54d2de0b248a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:57.263380 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7af71048-dd51-49a3-9f88-54d2de0b248a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:57.264153 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7af71048-dd51-49a3-9f88-54d2de0b248a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:57.264585 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7af71048-dd51-49a3-9f88-54d2de0b248a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:57.456309 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7af71048-dd51-49a3-9f88-54d2de0b248a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:57.464415 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7af71048-dd51-49a3-9f88-54d2de0b248a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.212229 Jul 18 10:48:57.465025 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 90/183] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:57 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:58.258150 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-335a8fc1-80d7-4c91-ae67-0487f6f58c62 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:58.258694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-335a8fc1-80d7-4c91-ae67-0487f6f58c62 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:58.265995 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-335a8fc1-80d7-4c91-ae67-0487f6f58c62 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:58.266877 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-335a8fc1-80d7-4c91-ae67-0487f6f58c62 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:58.267977 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-335a8fc1-80d7-4c91-ae67-0487f6f58c62 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:58.268564 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-335a8fc1-80d7-4c91-ae67-0487f6f58c62 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:58.486482 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-efd1931c-024c-45ce-99e9-70ef26f6a656 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:58.487899 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-efd1931c-024c-45ce-99e9-70ef26f6a656 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:58.498715 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-efd1931c-024c-45ce-99e9-70ef26f6a656 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:58.502822 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-efd1931c-024c-45ce-99e9-70ef26f6a656 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:58.502822 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-efd1931c-024c-45ce-99e9-70ef26f6a656 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:58.502822 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-efd1931c-024c-45ce-99e9-70ef26f6a656 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:58.506293 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-335a8fc1-80d7-4c91-ae67-0487f6f58c62 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:58.517873 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-335a8fc1-80d7-4c91-ae67-0487f6f58c62 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1266 microversion: 2.1 time: 0.263640 Jul 18 10:48:58.519100 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 94/184] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:58 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:58.657640 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-efd1931c-024c-45ce-99e9-70ef26f6a656 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:58.666117 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-efd1931c-024c-45ce-99e9-70ef26f6a656 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.185329 Jul 18 10:48:58.666823 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 91/185] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:58 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:59.536999 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2b8be313-fa26-402c-b39f-837b707ae301 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:59.537612 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2b8be313-fa26-402c-b39f-837b707ae301 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:59.544878 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2b8be313-fa26-402c-b39f-837b707ae301 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:59.545394 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2b8be313-fa26-402c-b39f-837b707ae301 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:59.546111 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2b8be313-fa26-402c-b39f-837b707ae301 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:59.546537 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2b8be313-fa26-402c-b39f-837b707ae301 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:59.684014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6e64377d-0454-4c78-9017-0ff165f57441 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:59.684624 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-6e64377d-0454-4c78-9017-0ff165f57441 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:59.693102 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e64377d-0454-4c78-9017-0ff165f57441 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:59.694831 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e64377d-0454-4c78-9017-0ff165f57441 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:59.696919 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e64377d-0454-4c78-9017-0ff165f57441 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:59.697364 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e64377d-0454-4c78-9017-0ff165f57441 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:59.912294 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2b8be313-fa26-402c-b39f-837b707ae301 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:59.920971 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2b8be313-fa26-402c-b39f-837b707ae301 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1314 microversion: 2.1 time: 0.388922 Jul 18 10:48:59.921667 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 95/186] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:59 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:59.927886 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3e579e9c-a0dc-431e-8f99-ad98aa492d17 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:59.928462 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3e579e9c-a0dc-431e-8f99-ad98aa492d17 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:59.934671 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3e579e9c-a0dc-431e-8f99-ad98aa492d17 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:59.935112 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3e579e9c-a0dc-431e-8f99-ad98aa492d17 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:59.935870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3e579e9c-a0dc-431e-8f99-ad98aa492d17 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:59.936364 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3e579e9c-a0dc-431e-8f99-ad98aa492d17 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:59.968733 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3e579e9c-a0dc-431e-8f99-ad98aa492d17 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/ips" status: 200 len: 146 microversion: 2.1 time: 0.044906 Jul 18 10:48:59.970579 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 96/187] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 18 10:48:59 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:59.983826 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6e64377d-0454-4c78-9017-0ff165f57441 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:59.991523 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-6e64377d-0454-4c78-9017-0ff165f57441 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.311597 Jul 18 10:48:59.992103 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 92/188] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:59 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:00.940029 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2ba3f08e-9813-499e-92b3-87ceb3775829 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:00.940626 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2ba3f08e-9813-499e-92b3-87ceb3775829 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:00.947629 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ba3f08e-9813-499e-92b3-87ceb3775829 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:00.948074 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ba3f08e-9813-499e-92b3-87ceb3775829 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:00.948873 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ba3f08e-9813-499e-92b3-87ceb3775829 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:00.949305 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ba3f08e-9813-499e-92b3-87ceb3775829 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:01.011717 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9b15463d-0ed7-468d-85a8-57deded58d3b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:01.011717 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-9b15463d-0ed7-468d-85a8-57deded58d3b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:01.024157 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9b15463d-0ed7-468d-85a8-57deded58d3b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:01.024706 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9b15463d-0ed7-468d-85a8-57deded58d3b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:01.025687 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9b15463d-0ed7-468d-85a8-57deded58d3b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:01.026285 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9b15463d-0ed7-468d-85a8-57deded58d3b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:01.262984 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2ba3f08e-9813-499e-92b3-87ceb3775829 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:01.273153 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2ba3f08e-9813-499e-92b3-87ceb3775829 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1314 microversion: 2.1 time: 0.338000 Jul 18 10:49:01.277574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 97/189] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:00 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:01.279004 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-ce915e6a-3cb3-4936-bf9b-b584740caba7 req-0cdc812a-7106-4e85-92bf-42d0cdf2aecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d37ed23-396c-4be2-af65-be5be1d4ebc8", "tag": "d4d87d55-226f-4ba5-b094-219691055a45"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:01.288189 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-ce915e6a-3cb3-4936-bf9b-b584740caba7 req-0cdc812a-7106-4e85-92bf-42d0cdf2aecb service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:01.288645 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-ce915e6a-3cb3-4936-bf9b-b584740caba7 req-0cdc812a-7106-4e85-92bf-42d0cdf2aecb service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:01.303869 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-ce915e6a-3cb3-4936-bf9b-b584740caba7 req-0cdc812a-7106-4e85-92bf-42d0cdf2aecb service nova] Creating event network-changed:d4d87d55-226f-4ba5-b094-219691055a45 for instance 0d37ed23-396c-4be2-af65-be5be1d4ebc8 on hv-cinder-84949 Jul 18 10:49:01.303986 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9b15463d-0ed7-468d-85a8-57deded58d3b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:01.310512 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-ce915e6a-3cb3-4936-bf9b-b584740caba7 req-0cdc812a-7106-4e85-92bf-42d0cdf2aecb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031332 Jul 18 10:49:01.310512 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 98/190] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:01.315147 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9b15463d-0ed7-468d-85a8-57deded58d3b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.309260 Jul 18 10:49:01.317653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 93/191] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:01 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:02.292513 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a09c26f6-7e36-4aae-b386-2323485337ca tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:02.293232 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a09c26f6-7e36-4aae-b386-2323485337ca tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:02.301438 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a09c26f6-7e36-4aae-b386-2323485337ca tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:02.301889 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a09c26f6-7e36-4aae-b386-2323485337ca tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:02.302662 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a09c26f6-7e36-4aae-b386-2323485337ca tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:02.303090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a09c26f6-7e36-4aae-b386-2323485337ca tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:02.335879 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2fcc6c68-f83f-4356-9036-95930184f478 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:02.336572 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2fcc6c68-f83f-4356-9036-95930184f478 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:02.342980 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2fcc6c68-f83f-4356-9036-95930184f478 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:02.343447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2fcc6c68-f83f-4356-9036-95930184f478 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:02.345016 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2fcc6c68-f83f-4356-9036-95930184f478 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:02.345519 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2fcc6c68-f83f-4356-9036-95930184f478 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:02.462570 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=2 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:02.488077 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=6 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:02.545428 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a09c26f6-7e36-4aae-b386-2323485337ca tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:02.552943 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-2fcc6c68-f83f-4356-9036-95930184f478 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:02.554247 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a09c26f6-7e36-4aae-b386-2323485337ca tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1314 microversion: 2.1 time: 0.266129 Jul 18 10:49:02.554836 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 99/192] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:02 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:02.560649 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2fcc6c68-f83f-4356-9036-95930184f478 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.230241 Jul 18 10:49:02.561317 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 94/193] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:02 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:03.572427 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6a2bb8bb-f39c-4186-8672-251d9696368a tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:03.573699 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6a2bb8bb-f39c-4186-8672-251d9696368a tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:03.578157 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2c35723e-1bd3-4119-9b35-1bdb3335d727 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:03.579539 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2c35723e-1bd3-4119-9b35-1bdb3335d727 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:03.580721 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6a2bb8bb-f39c-4186-8672-251d9696368a tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:03.581185 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6a2bb8bb-f39c-4186-8672-251d9696368a tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:03.582156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6a2bb8bb-f39c-4186-8672-251d9696368a tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:03.582582 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6a2bb8bb-f39c-4186-8672-251d9696368a tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:03.587471 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2c35723e-1bd3-4119-9b35-1bdb3335d727 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:03.590787 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2c35723e-1bd3-4119-9b35-1bdb3335d727 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:03.590787 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2c35723e-1bd3-4119-9b35-1bdb3335d727 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:03.590787 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2c35723e-1bd3-4119-9b35-1bdb3335d727 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:03.795000 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-6a2bb8bb-f39c-4186-8672-251d9696368a tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:03.798759 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-2c35723e-1bd3-4119-9b35-1bdb3335d727 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:03.805317 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6a2bb8bb-f39c-4186-8672-251d9696368a tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1314 microversion: 2.1 time: 0.236804 Jul 18 10:49:03.805897 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 100/194] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:03 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:03.815121 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2c35723e-1bd3-4119-9b35-1bdb3335d727 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.240920 Jul 18 10:49:03.815708 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 95/195] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:03 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:03.951140 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-cae7f6e3-5505-4592-a654-d5f83bc4a291 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13041eed-ddc9-49b3-b62a-ffb862a2fb9c"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:03.952301 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-cae7f6e3-5505-4592-a654-d5f83bc4a291 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:03.955027 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=4 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:03.960366 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cae7f6e3-5505-4592-a654-d5f83bc4a291 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:03.961088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cae7f6e3-5505-4592-a654-d5f83bc4a291 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:03.962116 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cae7f6e3-5505-4592-a654-d5f83bc4a291 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:03.962616 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cae7f6e3-5505-4592-a654-d5f83bc4a291 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:04.824026 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-63bbeb98-acfc-4331-9655-de1616bc5831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:04.824664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-63bbeb98-acfc-4331-9655-de1616bc5831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:04.831621 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-63bbeb98-acfc-4331-9655-de1616bc5831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:04.832068 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-63bbeb98-acfc-4331-9655-de1616bc5831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:04.832857 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-63bbeb98-acfc-4331-9655-de1616bc5831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:04.833385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-63bbeb98-acfc-4331-9655-de1616bc5831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:05.044411 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-63bbeb98-acfc-4331-9655-de1616bc5831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:05.054899 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-63bbeb98-acfc-4331-9655-de1616bc5831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1314 microversion: 2.1 time: 0.235158 Jul 18 10:49:05.056373 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 96/196] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:04 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:05.063355 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-95cadae7-4c41-430f-b842-fc86d9f80a9b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:05.067329 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-95cadae7-4c41-430f-b842-fc86d9f80a9b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:05.077885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-95cadae7-4c41-430f-b842-fc86d9f80a9b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:05.077885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-95cadae7-4c41-430f-b842-fc86d9f80a9b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:05.077885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-95cadae7-4c41-430f-b842-fc86d9f80a9b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:05.077885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-95cadae7-4c41-430f-b842-fc86d9f80a9b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:05.106879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-cae7f6e3-5505-4592-a654-d5f83bc4a291 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "POST /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.159573 Jul 18 10:49:05.108265 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 101/197] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 18 10:49:03 2022] POST /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/os-volume_attachments => generated 194 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:49:05.349186 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-95cadae7-4c41-430f-b842-fc86d9f80a9b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:05.362824 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-95cadae7-4c41-430f-b842-fc86d9f80a9b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.304153 Jul 18 10:49:05.365128 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 97/198] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:05 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:06.075248 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d1979398-37f2-482b-af13-bc537a710328 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:06.081157 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d1979398-37f2-482b-af13-bc537a710328 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:06.085042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d1979398-37f2-482b-af13-bc537a710328 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:06.085506 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d1979398-37f2-482b-af13-bc537a710328 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:06.086349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d1979398-37f2-482b-af13-bc537a710328 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:06.086790 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d1979398-37f2-482b-af13-bc537a710328 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:06.261281 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d1979398-37f2-482b-af13-bc537a710328 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:06.287233 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d1979398-37f2-482b-af13-bc537a710328 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1314 microversion: 2.1 time: 0.216649 Jul 18 10:49:06.288011 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 102/199] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:06 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:06.390673 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-978ffa4e-5419-4216-99d6-f710c3feeeaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:06.392153 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-978ffa4e-5419-4216-99d6-f710c3feeeaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:06.409740 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-978ffa4e-5419-4216-99d6-f710c3feeeaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:06.409740 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-978ffa4e-5419-4216-99d6-f710c3feeeaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:06.409740 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-978ffa4e-5419-4216-99d6-f710c3feeeaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:06.409740 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-978ffa4e-5419-4216-99d6-f710c3feeeaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:06.590391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-978ffa4e-5419-4216-99d6-f710c3feeeaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:06.600951 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-978ffa4e-5419-4216-99d6-f710c3feeeaa tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.217052 Jul 18 10:49:06.601782 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 98/200] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:06 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:07.301286 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-7a8597ec-6772-49b4-a1b7-d5fbad9c1c97 req-8812cd09-ce5d-4ee8-897a-7f099879f514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d37ed23-396c-4be2-af65-be5be1d4ebc8", "name": "network-vif-plugged", "status": "completed", "tag": "d4d87d55-226f-4ba5-b094-219691055a45"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:07.317895 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-7a8597ec-6772-49b4-a1b7-d5fbad9c1c97 req-8812cd09-ce5d-4ee8-897a-7f099879f514 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:07.318436 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-96d0656c-57f5-4a3f-b2ad-70487b59551f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:07.319204 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-96d0656c-57f5-4a3f-b2ad-70487b59551f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:07.319822 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-7a8597ec-6772-49b4-a1b7-d5fbad9c1c97 req-8812cd09-ce5d-4ee8-897a-7f099879f514 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:07.336224 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-7a8597ec-6772-49b4-a1b7-d5fbad9c1c97 req-8812cd09-ce5d-4ee8-897a-7f099879f514 service nova] Creating event network-vif-plugged:d4d87d55-226f-4ba5-b094-219691055a45 for instance 0d37ed23-396c-4be2-af65-be5be1d4ebc8 on hv-cinder-84949 Jul 18 10:49:07.348548 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-96d0656c-57f5-4a3f-b2ad-70487b59551f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:07.348548 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-96d0656c-57f5-4a3f-b2ad-70487b59551f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:07.348718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-7a8597ec-6772-49b4-a1b7-d5fbad9c1c97 req-8812cd09-ce5d-4ee8-897a-7f099879f514 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045034 Jul 18 10:49:07.348864 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-96d0656c-57f5-4a3f-b2ad-70487b59551f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:07.348955 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 103/201] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:07.349055 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-96d0656c-57f5-4a3f-b2ad-70487b59551f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:07.489307 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-96d0656c-57f5-4a3f-b2ad-70487b59551f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:07.512895 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-96d0656c-57f5-4a3f-b2ad-70487b59551f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1314 microversion: 2.1 time: 0.207548 Jul 18 10:49:07.512895 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 99/202] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:07 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:07.626972 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f15169e2-82b4-4bad-9262-3f5bb04c9490 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:07.627665 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f15169e2-82b4-4bad-9262-3f5bb04c9490 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:07.634155 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f15169e2-82b4-4bad-9262-3f5bb04c9490 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:07.634595 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f15169e2-82b4-4bad-9262-3f5bb04c9490 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:07.635365 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f15169e2-82b4-4bad-9262-3f5bb04c9490 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:07.635794 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f15169e2-82b4-4bad-9262-3f5bb04c9490 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:07.817905 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f15169e2-82b4-4bad-9262-3f5bb04c9490 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:07.826159 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f15169e2-82b4-4bad-9262-3f5bb04c9490 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.204500 Jul 18 10:49:07.826793 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 104/203] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:07 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:08.535592 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f6b9abe5-867c-4962-bfd9-fa4f3c14fdc5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:08.536190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f6b9abe5-867c-4962-bfd9-fa4f3c14fdc5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:08.542618 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f6b9abe5-867c-4962-bfd9-fa4f3c14fdc5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:08.543066 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f6b9abe5-867c-4962-bfd9-fa4f3c14fdc5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:08.543887 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f6b9abe5-867c-4962-bfd9-fa4f3c14fdc5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:08.544306 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f6b9abe5-867c-4962-bfd9-fa4f3c14fdc5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:08.714664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f6b9abe5-867c-4962-bfd9-fa4f3c14fdc5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:08.721573 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f6b9abe5-867c-4962-bfd9-fa4f3c14fdc5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1314 microversion: 2.1 time: 0.189872 Jul 18 10:49:08.722688 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 100/204] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:08 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:08.844289 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2ea7a140-1fb2-4792-b650-a5e4349e2122 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:08.845175 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2ea7a140-1fb2-4792-b650-a5e4349e2122 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:08.852661 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ea7a140-1fb2-4792-b650-a5e4349e2122 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:08.857422 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ea7a140-1fb2-4792-b650-a5e4349e2122 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:08.857422 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ea7a140-1fb2-4792-b650-a5e4349e2122 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:08.857422 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ea7a140-1fb2-4792-b650-a5e4349e2122 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:09.006779 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2ea7a140-1fb2-4792-b650-a5e4349e2122 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:09.020127 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2ea7a140-1fb2-4792-b650-a5e4349e2122 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.180366 Jul 18 10:49:09.020858 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 105/205] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:08 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:09.744986 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-65d6e8bd-94e9-498f-abbd-9fc78b081e4f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:09.746900 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-65d6e8bd-94e9-498f-abbd-9fc78b081e4f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:09.759131 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-65d6e8bd-94e9-498f-abbd-9fc78b081e4f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:09.759894 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-65d6e8bd-94e9-498f-abbd-9fc78b081e4f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:09.761238 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-65d6e8bd-94e9-498f-abbd-9fc78b081e4f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:09.761983 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-65d6e8bd-94e9-498f-abbd-9fc78b081e4f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:09.794008 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:09.976568 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-65d6e8bd-94e9-498f-abbd-9fc78b081e4f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:10.002119 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-65d6e8bd-94e9-498f-abbd-9fc78b081e4f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1314 microversion: 2.1 time: 0.263330 Jul 18 10:49:10.002772 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 101/206] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:09 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:10.039001 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d0d51661-683b-4115-81a6-ee1a4434c6e0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:10.052589 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d0d51661-683b-4115-81a6-ee1a4434c6e0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:10.052589 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d0d51661-683b-4115-81a6-ee1a4434c6e0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:10.052589 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d0d51661-683b-4115-81a6-ee1a4434c6e0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:10.052589 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d0d51661-683b-4115-81a6-ee1a4434c6e0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:10.053356 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d0d51661-683b-4115-81a6-ee1a4434c6e0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:10.199336 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d0d51661-683b-4115-81a6-ee1a4434c6e0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:10.209557 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d0d51661-683b-4115-81a6-ee1a4434c6e0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.174561 Jul 18 10:49:10.210166 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 106/207] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:10 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:10.616463 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f7cf8007-08ab-4d60-9f89-f2009763b438 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:10.616984 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f7cf8007-08ab-4d60-9f89-f2009763b438 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:10.623924 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f7cf8007-08ab-4d60-9f89-f2009763b438 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:10.624371 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f7cf8007-08ab-4d60-9f89-f2009763b438 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:10.625212 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f7cf8007-08ab-4d60-9f89-f2009763b438 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:10.625642 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f7cf8007-08ab-4d60-9f89-f2009763b438 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:10.650789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f7cf8007-08ab-4d60-9f89-f2009763b438 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/ips" status: 200 len: 149 microversion: 2.1 time: 0.039233 Jul 18 10:49:10.651444 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 102/208] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 18 10:49:10 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:11.020544 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-877f3f5a-533c-4440-bdc3-88b44fb8a998 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:11.021213 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-877f3f5a-533c-4440-bdc3-88b44fb8a998 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:11.027540 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-877f3f5a-533c-4440-bdc3-88b44fb8a998 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:11.027989 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-877f3f5a-533c-4440-bdc3-88b44fb8a998 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:11.028871 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-877f3f5a-533c-4440-bdc3-88b44fb8a998 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:11.029267 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-877f3f5a-533c-4440-bdc3-88b44fb8a998 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:11.176601 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-877f3f5a-533c-4440-bdc3-88b44fb8a998 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:11.178977 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:11.185313 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-877f3f5a-533c-4440-bdc3-88b44fb8a998 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1498 microversion: 2.1 time: 0.168771 Jul 18 10:49:11.185886 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 107/209] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:11 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1498 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:11.227703 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-98353968-e80c-4ad2-809b-b1e20607587a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:11.228394 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-98353968-e80c-4ad2-809b-b1e20607587a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:11.236477 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-98353968-e80c-4ad2-809b-b1e20607587a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:11.237091 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-98353968-e80c-4ad2-809b-b1e20607587a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:11.237996 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-98353968-e80c-4ad2-809b-b1e20607587a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:11.238516 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-98353968-e80c-4ad2-809b-b1e20607587a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:11.396650 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-98353968-e80c-4ad2-809b-b1e20607587a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:11.405906 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-98353968-e80c-4ad2-809b-b1e20607587a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.181982 Jul 18 10:49:11.407106 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 103/210] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:11 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:12.428605 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f08037ac-c652-4cff-9cfb-9758da158f6c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:12.429674 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f08037ac-c652-4cff-9cfb-9758da158f6c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:12.437333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f08037ac-c652-4cff-9cfb-9758da158f6c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:12.438573 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f08037ac-c652-4cff-9cfb-9758da158f6c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:12.439364 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f08037ac-c652-4cff-9cfb-9758da158f6c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:12.440035 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f08037ac-c652-4cff-9cfb-9758da158f6c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:12.610558 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f08037ac-c652-4cff-9cfb-9758da158f6c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:12.619660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f08037ac-c652-4cff-9cfb-9758da158f6c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.199383 Jul 18 10:49:12.620504 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 108/211] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:12 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:13.390664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a1c23423-ce3f-4852-bcf8-48628f519033 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:13.392522 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a1c23423-ce3f-4852-bcf8-48628f519033 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:13.399358 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a1c23423-ce3f-4852-bcf8-48628f519033 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:13.399714 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a1c23423-ce3f-4852-bcf8-48628f519033 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:13.400647 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a1c23423-ce3f-4852-bcf8-48628f519033 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:13.401133 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a1c23423-ce3f-4852-bcf8-48628f519033 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:13.433924 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a1c23423-ce3f-4852-bcf8-48628f519033 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/ips" status: 200 len: 151 microversion: 2.20 time: 0.048156 Jul 18 10:49:13.435411 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 104/212] 10.222.0.49 () {60 vars in 1288 bytes} [Mon Jul 18 10:49:13 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:49:13.623565 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-c6750703-967e-425d-9042-5639569b5d51 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e80ea525-8bda-45d2-90e7-a5f905bbfed1"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:13.625934 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-c6750703-967e-425d-9042-5639569b5d51 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:13.641191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c6750703-967e-425d-9042-5639569b5d51 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:13.641940 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c6750703-967e-425d-9042-5639569b5d51 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:13.643105 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c6750703-967e-425d-9042-5639569b5d51 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:13.643742 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c6750703-967e-425d-9042-5639569b5d51 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:13.653966 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f0bd4118-8b57-4b18-a9e8-c038e41fff24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:13.653966 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f0bd4118-8b57-4b18-a9e8-c038e41fff24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:13.667415 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f0bd4118-8b57-4b18-a9e8-c038e41fff24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:13.669193 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f0bd4118-8b57-4b18-a9e8-c038e41fff24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:13.670945 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f0bd4118-8b57-4b18-a9e8-c038e41fff24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:13.671744 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f0bd4118-8b57-4b18-a9e8-c038e41fff24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:13.937999 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f0bd4118-8b57-4b18-a9e8-c038e41fff24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:13.946640 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f0bd4118-8b57-4b18-a9e8-c038e41fff24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.308648 Jul 18 10:49:13.947231 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 105/213] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:13 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:14.219174 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d1ac023d-3489-4f6d-a8e5-9603604e35da tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:14.219174 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d1ac023d-3489-4f6d-a8e5-9603604e35da tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:14.231715 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d1ac023d-3489-4f6d-a8e5-9603604e35da tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:14.232607 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d1ac023d-3489-4f6d-a8e5-9603604e35da tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:14.234148 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d1ac023d-3489-4f6d-a8e5-9603604e35da tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:14.235826 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d1ac023d-3489-4f6d-a8e5-9603604e35da tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:14.285831 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d1ac023d-3489-4f6d-a8e5-9603604e35da tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Going to try to terminate instance {{(pid=125005) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:49:14.878219 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d1ac023d-3489-4f6d-a8e5-9603604e35da tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 204 len: 0 microversion: 2.1 time: 0.667860 Jul 18 10:49:14.879248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 106/214] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:49:14 2022] DELETE /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:49:14.887890 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-20e66d3f-be2a-4607-af3e-a7c02b8b7ed1 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:14.888588 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-20e66d3f-be2a-4607-af3e-a7c02b8b7ed1 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:14.895307 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-20e66d3f-be2a-4607-af3e-a7c02b8b7ed1 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:14.895741 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-20e66d3f-be2a-4607-af3e-a7c02b8b7ed1 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:14.896516 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-20e66d3f-be2a-4607-af3e-a7c02b8b7ed1 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:14.897004 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-20e66d3f-be2a-4607-af3e-a7c02b8b7ed1 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:15.066131 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-20e66d3f-be2a-4607-af3e-a7c02b8b7ed1 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:15.077245 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-20e66d3f-be2a-4607-af3e-a7c02b8b7ed1 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1504 microversion: 2.1 time: 0.193408 Jul 18 10:49:15.078249 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 107/215] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:14 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:15.086766 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-815fa7dc-80da-4690-8f22-7052a88b4be1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:15.087537 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-815fa7dc-80da-4690-8f22-7052a88b4be1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:15.095068 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-815fa7dc-80da-4690-8f22-7052a88b4be1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:15.096082 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-815fa7dc-80da-4690-8f22-7052a88b4be1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:15.096901 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-815fa7dc-80da-4690-8f22-7052a88b4be1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:15.097336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-815fa7dc-80da-4690-8f22-7052a88b4be1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:15.269180 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-815fa7dc-80da-4690-8f22-7052a88b4be1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:15.278944 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-815fa7dc-80da-4690-8f22-7052a88b4be1 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.199193 Jul 18 10:49:15.279972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 108/216] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:15 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:16.102626 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e0b3ef62-5c35-47be-8ecc-5bdd91764ea0 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:16.103299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e0b3ef62-5c35-47be-8ecc-5bdd91764ea0 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:16.111280 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e0b3ef62-5c35-47be-8ecc-5bdd91764ea0 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:16.111722 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e0b3ef62-5c35-47be-8ecc-5bdd91764ea0 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:16.112881 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e0b3ef62-5c35-47be-8ecc-5bdd91764ea0 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:16.113315 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e0b3ef62-5c35-47be-8ecc-5bdd91764ea0 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:16.296919 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e0b3ef62-5c35-47be-8ecc-5bdd91764ea0 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:16.305408 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e0b3ef62-5c35-47be-8ecc-5bdd91764ea0 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1504 microversion: 2.1 time: 0.207513 Jul 18 10:49:16.306398 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 109/217] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:16 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:16.311279 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-1a338390-806f-427c-a0a7-c4fc1befb8c3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:16.315033 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-1a338390-806f-427c-a0a7-c4fc1befb8c3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:16.322561 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1a338390-806f-427c-a0a7-c4fc1befb8c3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:16.322901 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1a338390-806f-427c-a0a7-c4fc1befb8c3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:16.323671 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1a338390-806f-427c-a0a7-c4fc1befb8c3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:16.324112 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1a338390-806f-427c-a0a7-c4fc1befb8c3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:16.354099 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-1a338390-806f-427c-a0a7-c4fc1befb8c3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lazy-loading 'flavor' on Instance uuid 14d05192-b009-41ab-861b-b66d0352d41e {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:49:17.301118 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-1a338390-806f-427c-a0a7-c4fc1befb8c3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "POST /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/action" status: 202 len: 0 microversion: 2.20 time: 0.993554 Jul 18 10:49:17.302825 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 110/218] 10.222.0.49 () {62 vars in 1318 bytes} [Mon Jul 18 10:49:16 2022] POST /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/action => generated 0 bytes in 996 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:49:17.316397 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a05e5568-531a-4a8f-be7f-885804467b01 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:17.320216 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a05e5568-531a-4a8f-be7f-885804467b01 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:17.338254 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a05e5568-531a-4a8f-be7f-885804467b01 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:17.338710 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a05e5568-531a-4a8f-be7f-885804467b01 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:17.339578 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a05e5568-531a-4a8f-be7f-885804467b01 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:17.340027 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a05e5568-531a-4a8f-be7f-885804467b01 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:17.420219 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-c6750703-967e-425d-9042-5639569b5d51 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "POST /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.804472 Jul 18 10:49:17.421482 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 109/219] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 18 10:49:13 2022] POST /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments => generated 194 bytes in 3807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:49:17.444247 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-7e4b68c9-011c-4781-8d91-36d8e954ded3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:17.445071 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-7e4b68c9-011c-4781-8d91-36d8e954ded3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:17.453221 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7e4b68c9-011c-4781-8d91-36d8e954ded3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:17.453846 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7e4b68c9-011c-4781-8d91-36d8e954ded3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:17.454817 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7e4b68c9-011c-4781-8d91-36d8e954ded3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:17.455315 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7e4b68c9-011c-4781-8d91-36d8e954ded3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:17.700228 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a05e5568-531a-4a8f-be7f-885804467b01 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:17.710832 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a05e5568-531a-4a8f-be7f-885804467b01 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.406598 Jul 18 10:49:17.711750 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 111/220] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:17 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:17.716889 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7e081ef1-dd8d-4a11-b18f-431f4896d522 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:17.717710 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-7e081ef1-dd8d-4a11-b18f-431f4896d522 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:17.727698 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7e081ef1-dd8d-4a11-b18f-431f4896d522 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:17.729371 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7e081ef1-dd8d-4a11-b18f-431f4896d522 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:17.730963 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7e081ef1-dd8d-4a11-b18f-431f4896d522 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:17.731573 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7e081ef1-dd8d-4a11-b18f-431f4896d522 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:17.801669 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7e4b68c9-011c-4781-8d91-36d8e954ded3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:17.819083 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7e4b68c9-011c-4781-8d91-36d8e954ded3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:17.825813 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7e4b68c9-011c-4781-8d91-36d8e954ded3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:17.829832 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-7e4b68c9-011c-4781-8d91-36d8e954ded3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.406177 Jul 18 10:49:17.835495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 110/221] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:17 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:17.848071 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6a39be30-9d63-45b1-a920-062a3d348df9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:17.858928 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6a39be30-9d63-45b1-a920-062a3d348df9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:17.859951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6a39be30-9d63-45b1-a920-062a3d348df9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:17.877809 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7e081ef1-dd8d-4a11-b18f-431f4896d522 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:17.886463 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7e081ef1-dd8d-4a11-b18f-431f4896d522 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1462 microversion: 2.1 time: 0.173247 Jul 18 10:49:17.897640 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 112/222] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:17 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1462 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:17.902901 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-9397c60d-ba3d-4e07-939d-ad53afe218da req-03c63b76-6de5-4b18-b2c4-4ed81d8dd506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d37ed23-396c-4be2-af65-be5be1d4ebc8", "name": "network-vif-deleted", "tag": "d4d87d55-226f-4ba5-b094-219691055a45"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:17.915109 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-9397c60d-ba3d-4e07-939d-ad53afe218da req-03c63b76-6de5-4b18-b2c4-4ed81d8dd506 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:17.915109 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-9397c60d-ba3d-4e07-939d-ad53afe218da req-03c63b76-6de5-4b18-b2c4-4ed81d8dd506 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:17.926055 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-9397c60d-ba3d-4e07-939d-ad53afe218da req-03c63b76-6de5-4b18-b2c4-4ed81d8dd506 service nova] Creating event network-vif-deleted:d4d87d55-226f-4ba5-b094-219691055a45 for instance 0d37ed23-396c-4be2-af65-be5be1d4ebc8 on hv-cinder-84949 Jul 18 10:49:17.931726 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-9397c60d-ba3d-4e07-939d-ad53afe218da req-03c63b76-6de5-4b18-b2c4-4ed81d8dd506 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032448 Jul 18 10:49:17.932376 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 113/223] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:17.935190 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6a39be30-9d63-45b1-a920-062a3d348df9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Going to try to stop instance {{(pid=125007) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 10:49:18.211679 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6a39be30-9d63-45b1-a920-062a3d348df9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "POST /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/action" status: 202 len: 0 microversion: 2.1 time: 0.374319 Jul 18 10:49:18.212322 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 111/224] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 18 10:49:17 2022] POST /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:49:18.222817 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-679527d4-5587-490c-8aa2-37eb61787338 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:18.224367 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-679527d4-5587-490c-8aa2-37eb61787338 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:18.230780 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-679527d4-5587-490c-8aa2-37eb61787338 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:18.231216 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-679527d4-5587-490c-8aa2-37eb61787338 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:18.232248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-679527d4-5587-490c-8aa2-37eb61787338 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:18.232744 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-679527d4-5587-490c-8aa2-37eb61787338 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:18.534020 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-679527d4-5587-490c-8aa2-37eb61787338 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:18.544188 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-679527d4-5587-490c-8aa2-37eb61787338 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1724 microversion: 2.1 time: 0.327187 Jul 18 10:49:18.545218 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 114/225] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:18 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:18.735987 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9cbe0f9f-47f9-4951-9561-c3e4de6d2e24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:18.738098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9cbe0f9f-47f9-4951-9561-c3e4de6d2e24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:18.748640 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=58 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:18.748640 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9cbe0f9f-47f9-4951-9561-c3e4de6d2e24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:18.748640 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9cbe0f9f-47f9-4951-9561-c3e4de6d2e24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:18.748640 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9cbe0f9f-47f9-4951-9561-c3e4de6d2e24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:18.749256 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9cbe0f9f-47f9-4951-9561-c3e4de6d2e24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:18.864485 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-94c22de7-758d-442e-b692-aff352f8edd6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:18.865257 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-94c22de7-758d-442e-b692-aff352f8edd6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:18.871654 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-94c22de7-758d-442e-b692-aff352f8edd6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:18.872159 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-94c22de7-758d-442e-b692-aff352f8edd6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:18.873256 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-94c22de7-758d-442e-b692-aff352f8edd6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:18.873598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-94c22de7-758d-442e-b692-aff352f8edd6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:18.927941 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9cbe0f9f-47f9-4951-9561-c3e4de6d2e24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:18.951955 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9cbe0f9f-47f9-4951-9561-c3e4de6d2e24 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1501 microversion: 2.1 time: 0.223809 Jul 18 10:49:18.967775 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 112/226] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:18 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1501 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:18.975844 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9597dc6c-de40-4cff-98e7-8f0e233a5d08 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:18.976459 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9597dc6c-de40-4cff-98e7-8f0e233a5d08 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:18.984724 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9597dc6c-de40-4cff-98e7-8f0e233a5d08 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:18.985401 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9597dc6c-de40-4cff-98e7-8f0e233a5d08 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:18.986191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9597dc6c-de40-4cff-98e7-8f0e233a5d08 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:18.986611 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9597dc6c-de40-4cff-98e7-8f0e233a5d08 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:19.027862 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9597dc6c-de40-4cff-98e7-8f0e233a5d08 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:19.028309 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9597dc6c-de40-4cff-98e7-8f0e233a5d08 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:19.029092 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-9597dc6c-de40-4cff-98e7-8f0e233a5d08 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lazy-loading 'fault' on Instance uuid 0d37ed23-396c-4be2-af65-be5be1d4ebc8 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:49:19.097179 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9597dc6c-de40-4cff-98e7-8f0e233a5d08 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:19.103700 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-94c22de7-758d-442e-b692-aff352f8edd6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:19.105127 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:19.112293 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9597dc6c-de40-4cff-98e7-8f0e233a5d08 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 200 len: 1304 microversion: 2.1 time: 0.142744 Jul 18 10:49:19.113066 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 113/227] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:18 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:19.113190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-94c22de7-758d-442e-b692-aff352f8edd6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:19.114809 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-94c22de7-758d-442e-b692-aff352f8edd6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:19.118294 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-94c22de7-758d-442e-b692-aff352f8edd6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.258648 Jul 18 10:49:19.120772 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4e3c452f-8001-4b92-89a6-9985a0df8f0b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "194e8cac-9396-4eaf-92be-d3f71da2e7b0"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:19.122362 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-4e3c452f-8001-4b92-89a6-9985a0df8f0b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:19.130377 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4e3c452f-8001-4b92-89a6-9985a0df8f0b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:19.130832 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4e3c452f-8001-4b92-89a6-9985a0df8f0b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:19.131619 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4e3c452f-8001-4b92-89a6-9985a0df8f0b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:19.132068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4e3c452f-8001-4b92-89a6-9985a0df8f0b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:19.134922 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 115/228] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:18 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:19.162658 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-4e3c452f-8001-4b92-89a6-9985a0df8f0b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] HTTP exception thrown: Cannot 'attach_volume' instance 4728713a-e4cd-4e09-b104-7a57de4f2242 while it is in vm_state rescued Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4e3c452f-8001-4b92-89a6-9985a0df8f0b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Request method failure captured: Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: POST /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242/os-volume_attachments HTTP/1.1 Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 74 Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To0Hl7Z7tH4wrosljtOhuMMHcXL6pbeD1JuHCgjD-oe7va1swEl_8GoI03QFcODlczAxCQbyvU0gTRqpouGzPswCVdRlGstD4W0yiS7plk3qIPQYhozJnU_oV-MWNpSc406Kvd4flOyJY-_9P0GucpgDhdqM1T2S-0iE92Vf0JN-p8 Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 7184d0f3256344a2af18c639787e538f Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1177899909 Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:49:19.164368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:49:19.165861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7184d0f3256344a2af18c639787e538f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7184d0f3256344a2af18c639787e538f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7184d0f3256344a2af18c639787e538f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7184d0f3256344a2af18c639787e538f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:49:19.165861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1177899909 Jul 18 10:49:19.165861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 7184d0f3256344a2af18c639787e538f Jul 18 10:49:19.165861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1177899909 Jul 18 10:49:19.165861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-ServerRescueNegativeTestJSON-1177899909-project Jul 18 10:49:19.165861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:49:19.165861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:49:19.165861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: e7a738986f87470681c6a578599a089f Jul 18 10:49:19.165861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1177899909-project Jul 18 10:49:19.165861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Jul 18 10:49:19.165861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {"volumeAttachment": {"volumeId": "194e8cac-9396-4eaf-92be-d3f71da2e7b0"}} Jul 18 10:49:19.165861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Cannot 'attach_volume' instance 4728713a-e4cd-4e09-b104-7a57de4f2242 while it is in vm_state rescued Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'server_id': '4728713a-e4cd-4e09-b104-7a57de4f2242', 'body': {'volumeAttachment': {'volumeId': '194e8cac-9396-4eaf-92be-d3f71da2e7b0'}}} Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4728713a-e4cd-4e09-b104-7a57de4f2242 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:49:19.166716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4728713a-e4cd-4e09-b104-7a57de4f2242 while it is in vm_state rescued Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:49:19.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:49:19.169387 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:49:19.169387 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:49:19.169387 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4728713a-e4cd-4e09-b104-7a57de4f2242 while it is in vm_state rescued Jul 18 10:49:19.169387 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:49:19.169387 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4e3c452f-8001-4b92-89a6-9985a0df8f0b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Returning 409 to user: Cannot 'attach_volume' instance 4728713a-e4cd-4e09-b104-7a57de4f2242 while it is in vm_state rescued {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:49:19.169387 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4e3c452f-8001-4b92-89a6-9985a0df8f0b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "POST /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050600 Jul 18 10:49:19.169387 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 114/229] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 18 10:49:19 2022] POST /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 10:49:19.186679 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-79905983-f2cf-4486-84df-4a823744092d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:19.187380 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-79905983-f2cf-4486-84df-4a823744092d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:19.194946 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-79905983-f2cf-4486-84df-4a823744092d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:19.195388 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-79905983-f2cf-4486-84df-4a823744092d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:19.196159 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-79905983-f2cf-4486-84df-4a823744092d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:19.196591 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-79905983-f2cf-4486-84df-4a823744092d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:19.566810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f14db038-2bc5-40db-a44c-026019e90e04 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:19.567710 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f14db038-2bc5-40db-a44c-026019e90e04 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:19.575717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f14db038-2bc5-40db-a44c-026019e90e04 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:19.576310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f14db038-2bc5-40db-a44c-026019e90e04 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:19.577449 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f14db038-2bc5-40db-a44c-026019e90e04 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:19.578243 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f14db038-2bc5-40db-a44c-026019e90e04 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:19.601048 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-79905983-f2cf-4486-84df-4a823744092d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "POST /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242/action" status: 202 len: 0 microversion: 2.1 time: 0.416487 Jul 18 10:49:19.601048 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 116/230] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 18 10:49:19 2022] POST /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:49:19.613132 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d0b67235-758c-44f9-94a1-55f09c6aed05 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:19.614263 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d0b67235-758c-44f9-94a1-55f09c6aed05 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:19.623178 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d0b67235-758c-44f9-94a1-55f09c6aed05 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:19.623527 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d0b67235-758c-44f9-94a1-55f09c6aed05 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:19.624585 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d0b67235-758c-44f9-94a1-55f09c6aed05 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:19.625338 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d0b67235-758c-44f9-94a1-55f09c6aed05 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:19.908977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-d0b67235-758c-44f9-94a1-55f09c6aed05 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:19.915295 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f14db038-2bc5-40db-a44c-026019e90e04 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:19.922031 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d0b67235-758c-44f9-94a1-55f09c6aed05 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1509 microversion: 2.1 time: 0.315801 Jul 18 10:49:19.924121 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 117/231] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:19 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1509 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:19.931010 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f14db038-2bc5-40db-a44c-026019e90e04 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1724 microversion: 2.1 time: 0.371537 Jul 18 10:49:19.931883 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 115/232] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:19 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1724 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:20.135688 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bc7e3d0e-447f-4cda-8fe6-af954ea3e668 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:20.136294 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-bc7e3d0e-447f-4cda-8fe6-af954ea3e668 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: 0d37ed23-396c-4be2-af65-be5be1d4ebc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:20.145274 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bc7e3d0e-447f-4cda-8fe6-af954ea3e668 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:20.145968 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bc7e3d0e-447f-4cda-8fe6-af954ea3e668 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:20.147123 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bc7e3d0e-447f-4cda-8fe6-af954ea3e668 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:20.147550 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bc7e3d0e-447f-4cda-8fe6-af954ea3e668 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:20.158587 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-bed91e1b-5ef9-4d77-abf4-e87e25eec20c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:20.159835 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-bed91e1b-5ef9-4d77-abf4-e87e25eec20c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:20.166909 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-bc7e3d0e-447f-4cda-8fe6-af954ea3e668 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] HTTP exception thrown: Instance 0d37ed23-396c-4be2-af65-be5be1d4ebc8 could not be found. Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bc7e3d0e-447f-4cda-8fe6-af954ea3e668 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Request method failure captured: Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 HTTP/1.1 Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1TqR-p1TDnnR6OhImeKzxqzrlE-v5EQSUh8mFCDqWZ413Ct388Emb0RoKXGqn1Nv9Ey9UYEJcnmUlQUgyOxTG9M2Djio8bmymHnsnnaoMiTFGd_uCojtUIdVyR2IrTOGNZik6SqTmfZ4ad6-Amp_aui3e6zhaU09cR98p72qyho_tXg Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: e8ea247cf5a540768bbbc7260b74f11c Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-VolumesActionsTest-2102060617 Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:49:20.169114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:49:20.170581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e8ea247cf5a540768bbbc7260b74f11c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e8ea247cf5a540768bbbc7260b74f11c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e8ea247cf5a540768bbbc7260b74f11c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e8ea247cf5a540768bbbc7260b74f11c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:49:20.170581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-VolumesActionsTest-2102060617 Jul 18 10:49:20.170581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: e8ea247cf5a540768bbbc7260b74f11c Jul 18 10:49:20.170581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-VolumesActionsTest-2102060617 Jul 18 10:49:20.170581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-VolumesActionsTest-2102060617-project Jul 18 10:49:20.170581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:49:20.170581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:49:20.170581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 49e86a3f10b64ef38664013e197782c3 Jul 18 10:49:20.170581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-VolumesActionsTest-2102060617-project Jul 18 10:49:20.170581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:49:20.170581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 0d37ed23-396c-4be2-af65-be5be1d4ebc8 could not be found. Jul 18 10:49:20.170581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '0d37ed23-396c-4be2-af65-be5be1d4ebc8'} Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d37ed23-396c-4be2-af65-be5be1d4ebc8 could not be found. Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:49:20.171385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d37ed23-396c-4be2-af65-be5be1d4ebc8 could not be found. Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d37ed23-396c-4be2-af65-be5be1d4ebc8 could not be found. Jul 18 10:49:20.172975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:49:20.175615 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bed91e1b-5ef9-4d77-abf4-e87e25eec20c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:20.175615 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bed91e1b-5ef9-4d77-abf4-e87e25eec20c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:20.175938 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bc7e3d0e-447f-4cda-8fe6-af954ea3e668 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Returning 404 to user: Instance 0d37ed23-396c-4be2-af65-be5be1d4ebc8 could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:49:20.176086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bed91e1b-5ef9-4d77-abf4-e87e25eec20c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:20.176217 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-bc7e3d0e-447f-4cda-8fe6-af954ea3e668 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8" status: 404 len: 111 microversion: 2.1 time: 0.038826 Jul 18 10:49:20.176346 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bed91e1b-5ef9-4d77-abf4-e87e25eec20c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:20.176486 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 118/233] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:20 2022] GET /compute/v2.1/servers/0d37ed23-396c-4be2-af65-be5be1d4ebc8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:49:20.338973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1698701792", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "networks": [{"uuid": "68c9cc30-3e35-4ed5-8849-6c07232ca4ed"}]}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:20.399294 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.network.neutron [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] validate_networks() for [('68c9cc30-3e35-4ed5-8849-6c07232ca4ed', None, None, None, None, None)] {{(pid=125005) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:49:20.480200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-bed91e1b-5ef9-4d77-abf4-e87e25eec20c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:20.490515 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-bed91e1b-5ef9-4d77-abf4-e87e25eec20c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:20.492280 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-bed91e1b-5ef9-4d77-abf4-e87e25eec20c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:20.493634 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-bed91e1b-5ef9-4d77-abf4-e87e25eec20c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.354877 Jul 18 10:49:20.494398 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 116/234] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:20 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:20.941231 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-bdf20e14-72e6-4617-8246-83a152ebb94d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:20.941866 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-bdf20e14-72e6-4617-8246-83a152ebb94d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:20.948994 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bdf20e14-72e6-4617-8246-83a152ebb94d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:20.949491 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bdf20e14-72e6-4617-8246-83a152ebb94d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:20.950305 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bdf20e14-72e6-4617-8246-83a152ebb94d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:20.950744 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bdf20e14-72e6-4617-8246-83a152ebb94d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:20.982755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Flavor limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:49:20.983266 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Image limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:49:20.983662 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Flavor pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:49:20.984757 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Image pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:49:20.985665 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:49:20.997939 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:20.998675 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:20.999656 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:21.000771 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:21.022899 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Getting quotas for project e8ea247cf5a540768bbbc7260b74f11c. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:49:21.028212 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Getting quotas for user 49e86a3f10b64ef38664013e197782c3 and project e8ea247cf5a540768bbbc7260b74f11c. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:49:21.042643 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Going to run 1 instances... {{(pid=125005) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:49:21.045765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125005) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:49:21.083440 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:21.176507 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-bdf20e14-72e6-4617-8246-83a152ebb94d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:21.185744 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-bdf20e14-72e6-4617-8246-83a152ebb94d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1509 microversion: 2.1 time: 0.248113 Jul 18 10:49:21.186796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 117/235] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:20 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1509 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:21.195874 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-410e8768-28f0-40ac-83a4-9ab20631bfd7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:21.197009 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-410e8768-28f0-40ac-83a4-9ab20631bfd7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:21.209389 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-410e8768-28f0-40ac-83a4-9ab20631bfd7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:21.210185 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-410e8768-28f0-40ac-83a4-9ab20631bfd7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:21.212535 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-410e8768-28f0-40ac-83a4-9ab20631bfd7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:21.213368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-410e8768-28f0-40ac-83a4-9ab20631bfd7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:21.241759 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2786f292-205b-4ba0-8f28-3834ebe7b74c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912032 Jul 18 10:49:21.243675 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 119/236] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:49:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 10:49:21.284969 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f6aa134d-8baa-4d4b-8ea5-f864c06afd81 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:21.288639 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f6aa134d-8baa-4d4b-8ea5-f864c06afd81 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:21.418289 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f6aa134d-8baa-4d4b-8ea5-f864c06afd81 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:21.435596 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f6aa134d-8baa-4d4b-8ea5-f864c06afd81 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1214 microversion: 2.1 time: 0.172530 Jul 18 10:49:21.435596 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 120/237] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:21 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1214 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:21.516016 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-4ef8692e-476b-40ab-a4c0-06103c075e33 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:21.516016 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-4ef8692e-476b-40ab-a4c0-06103c075e33 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:21.525148 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4ef8692e-476b-40ab-a4c0-06103c075e33 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:21.525599 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4ef8692e-476b-40ab-a4c0-06103c075e33 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:21.526445 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4ef8692e-476b-40ab-a4c0-06103c075e33 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:21.532019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4ef8692e-476b-40ab-a4c0-06103c075e33 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:21.577614 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-410e8768-28f0-40ac-83a4-9ab20631bfd7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:21.590815 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-410e8768-28f0-40ac-83a4-9ab20631bfd7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1724 microversion: 2.1 time: 0.402225 Jul 18 10:49:21.591631 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 118/238] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:21 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:21.705837 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4ef8692e-476b-40ab-a4c0-06103c075e33 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:21.714101 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4ef8692e-476b-40ab-a4c0-06103c075e33 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:21.715695 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4ef8692e-476b-40ab-a4c0-06103c075e33 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:21.716878 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-4ef8692e-476b-40ab-a4c0-06103c075e33 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.209297 Jul 18 10:49:21.717440 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 121/239] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:21 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:22.204740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b3f01cfd-e7ef-4ace-ac1d-2a01096075de tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:22.205386 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b3f01cfd-e7ef-4ace-ac1d-2a01096075de tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:22.212723 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b3f01cfd-e7ef-4ace-ac1d-2a01096075de tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:22.213219 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b3f01cfd-e7ef-4ace-ac1d-2a01096075de tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:22.214080 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b3f01cfd-e7ef-4ace-ac1d-2a01096075de tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:22.214603 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b3f01cfd-e7ef-4ace-ac1d-2a01096075de tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:22.451866 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a293d191-f66c-4090-b11b-457908c2f6f0 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:22.452502 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a293d191-f66c-4090-b11b-457908c2f6f0 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:22.592215 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a293d191-f66c-4090-b11b-457908c2f6f0 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:22.605697 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a293d191-f66c-4090-b11b-457908c2f6f0 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1214 microversion: 2.1 time: 0.153322 Jul 18 10:49:22.606223 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 122/240] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:22 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:22.611673 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-eff48592-51da-4bf7-b4fc-bb79837d617a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:22.612707 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-eff48592-51da-4bf7-b4fc-bb79837d617a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:22.619006 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-eff48592-51da-4bf7-b4fc-bb79837d617a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:22.619687 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-eff48592-51da-4bf7-b4fc-bb79837d617a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:22.620495 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-eff48592-51da-4bf7-b4fc-bb79837d617a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:22.621072 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-eff48592-51da-4bf7-b4fc-bb79837d617a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:22.749542 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b3f01cfd-e7ef-4ace-ac1d-2a01096075de tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:22.758637 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b3f01cfd-e7ef-4ace-ac1d-2a01096075de tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1509 microversion: 2.1 time: 0.558377 Jul 18 10:49:22.759323 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 119/241] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:22 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1509 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:22.764190 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-646bc2fb-9f4d-424b-942f-e53eff444769 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:22.767520 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-646bc2fb-9f4d-424b-942f-e53eff444769 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:22.772303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-646bc2fb-9f4d-424b-942f-e53eff444769 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:22.773765 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-646bc2fb-9f4d-424b-942f-e53eff444769 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:22.774722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-646bc2fb-9f4d-424b-942f-e53eff444769 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:22.775367 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-646bc2fb-9f4d-424b-942f-e53eff444769 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:22.806784 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-eff48592-51da-4bf7-b4fc-bb79837d617a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:22.819203 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-eff48592-51da-4bf7-b4fc-bb79837d617a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1724 microversion: 2.1 time: 0.211613 Jul 18 10:49:22.820106 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 123/242] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:22 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:22.942882 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-646bc2fb-9f4d-424b-942f-e53eff444769 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:22.951882 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-646bc2fb-9f4d-424b-942f-e53eff444769 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:22.954187 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-646bc2fb-9f4d-424b-942f-e53eff444769 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:22.955459 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-646bc2fb-9f4d-424b-942f-e53eff444769 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.194977 Jul 18 10:49:22.956851 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 120/243] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:22 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:23.621323 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f924579b-be35-4e6d-98f9-75e7e5f64519 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:23.623016 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f924579b-be35-4e6d-98f9-75e7e5f64519 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:23.634353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f924579b-be35-4e6d-98f9-75e7e5f64519 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:23.634998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f924579b-be35-4e6d-98f9-75e7e5f64519 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:23.635928 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f924579b-be35-4e6d-98f9-75e7e5f64519 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:23.636359 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f924579b-be35-4e6d-98f9-75e7e5f64519 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:23.724604 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f924579b-be35-4e6d-98f9-75e7e5f64519 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:23.733068 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f924579b-be35-4e6d-98f9-75e7e5f64519 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1266 microversion: 2.1 time: 0.116791 Jul 18 10:49:23.733633 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 124/244] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:23 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:23.779263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f8f37d31-f173-4bf1-8baa-d9bdb23a5eb4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:23.779864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f8f37d31-f173-4bf1-8baa-d9bdb23a5eb4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:23.787125 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f8f37d31-f173-4bf1-8baa-d9bdb23a5eb4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:23.787571 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f8f37d31-f173-4bf1-8baa-d9bdb23a5eb4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:23.788343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f8f37d31-f173-4bf1-8baa-d9bdb23a5eb4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:23.790775 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f8f37d31-f173-4bf1-8baa-d9bdb23a5eb4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:23.837463 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-aaeecbbd-1523-4616-9f92-0ae0b53a3722 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:23.838106 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-aaeecbbd-1523-4616-9f92-0ae0b53a3722 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:23.845094 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-aaeecbbd-1523-4616-9f92-0ae0b53a3722 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:23.845822 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-aaeecbbd-1523-4616-9f92-0ae0b53a3722 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:23.846608 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-aaeecbbd-1523-4616-9f92-0ae0b53a3722 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:23.847057 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-aaeecbbd-1523-4616-9f92-0ae0b53a3722 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:24.012487 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f8f37d31-f173-4bf1-8baa-d9bdb23a5eb4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:24.016698 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f8f37d31-f173-4bf1-8baa-d9bdb23a5eb4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1515 microversion: 2.1 time: 0.241289 Jul 18 10:49:24.018539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 121/245] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:23 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1515 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:24.025214 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-76acfc93-e8eb-490e-a1e4-eb0e32b03815 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:24.025992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-76acfc93-e8eb-490e-a1e4-eb0e32b03815 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:24.034740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-76acfc93-e8eb-490e-a1e4-eb0e32b03815 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:24.035418 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-76acfc93-e8eb-490e-a1e4-eb0e32b03815 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:24.037977 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-76acfc93-e8eb-490e-a1e4-eb0e32b03815 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:24.038708 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-76acfc93-e8eb-490e-a1e4-eb0e32b03815 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:24.045842 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:24.316743 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-aaeecbbd-1523-4616-9f92-0ae0b53a3722 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:24.327318 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-aaeecbbd-1523-4616-9f92-0ae0b53a3722 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1724 microversion: 2.1 time: 0.493747 Jul 18 10:49:24.327945 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 125/246] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:23 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1724 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:24.389044 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-76acfc93-e8eb-490e-a1e4-eb0e32b03815 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:24.398613 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-76acfc93-e8eb-490e-a1e4-eb0e32b03815 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:24.411637 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-76acfc93-e8eb-490e-a1e4-eb0e32b03815 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:24.412891 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-76acfc93-e8eb-490e-a1e4-eb0e32b03815 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.393174 Jul 18 10:49:24.418506 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 122/247] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:24 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:24.753176 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6884f5e5-bdac-4f6a-9707-e1d7f6c46803 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:24.754065 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-6884f5e5-bdac-4f6a-9707-e1d7f6c46803 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:24.760823 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6884f5e5-bdac-4f6a-9707-e1d7f6c46803 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:24.761310 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6884f5e5-bdac-4f6a-9707-e1d7f6c46803 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:24.762086 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6884f5e5-bdac-4f6a-9707-e1d7f6c46803 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:24.762676 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6884f5e5-bdac-4f6a-9707-e1d7f6c46803 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:24.858246 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6884f5e5-bdac-4f6a-9707-e1d7f6c46803 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:24.873681 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-6884f5e5-bdac-4f6a-9707-e1d7f6c46803 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1274 microversion: 2.1 time: 0.124324 Jul 18 10:49:24.878035 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 126/248] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:24 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1274 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:25.348357 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-663cde73-4ae2-4d7c-84f3-1d746e2f82c7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:25.349558 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-663cde73-4ae2-4d7c-84f3-1d746e2f82c7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:25.362752 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-663cde73-4ae2-4d7c-84f3-1d746e2f82c7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:25.364071 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-663cde73-4ae2-4d7c-84f3-1d746e2f82c7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:25.367389 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-663cde73-4ae2-4d7c-84f3-1d746e2f82c7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:25.369633 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-663cde73-4ae2-4d7c-84f3-1d746e2f82c7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:25.437069 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-126d8981-f154-492c-9789-4b35532bb734 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:25.438009 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-126d8981-f154-492c-9789-4b35532bb734 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:25.450113 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-126d8981-f154-492c-9789-4b35532bb734 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:25.451032 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-126d8981-f154-492c-9789-4b35532bb734 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:25.452680 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-126d8981-f154-492c-9789-4b35532bb734 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:25.453865 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-126d8981-f154-492c-9789-4b35532bb734 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:26.006043 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-663cde73-4ae2-4d7c-84f3-1d746e2f82c7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:26.014771 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-663cde73-4ae2-4d7c-84f3-1d746e2f82c7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1724 microversion: 2.1 time: 0.673546 Jul 18 10:49:26.015584 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 123/249] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:25 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1724 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:26.045133 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-126d8981-f154-492c-9789-4b35532bb734 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:26.045133 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-126d8981-f154-492c-9789-4b35532bb734 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:26.045977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-126d8981-f154-492c-9789-4b35532bb734 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:26.045977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-126d8981-f154-492c-9789-4b35532bb734 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.600973 Jul 18 10:49:26.045977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 127/250] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:25 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:26.046206 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-df7ae95a-9834-4a34-bb55-208a3faa0c70 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:26.046206 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-df7ae95a-9834-4a34-bb55-208a3faa0c70 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:26.052030 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-df7ae95a-9834-4a34-bb55-208a3faa0c70 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:26.052491 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-df7ae95a-9834-4a34-bb55-208a3faa0c70 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:26.053310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-df7ae95a-9834-4a34-bb55-208a3faa0c70 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:26.053749 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-df7ae95a-9834-4a34-bb55-208a3faa0c70 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:26.074326 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-22ce720d-66b9-433a-b93f-c1a2fdd799c0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Action: 'create', calling method: .version_select at 0x7f6365681f70>, body: {"keypair": {"name": "tempest-keypair-280716380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnql0A3huZVMHZnXpk7YZU83VAH6P5yrDG8hYaB6/Gtlo+W4ObWf4c9+OtcnFkCbwBpPXZlc3NSpC8EPl7nUWMk4FC+0KMO4G4lpZ0Jx/y9FDiCirW0XIUntOoZsx3gFg=="}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:26.096862 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-22ce720d-66b9-433a-b93f-c1a2fdd799c0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Getting quotas for project 7184d0f3256344a2af18c639787e538f. Resources: {'key_pairs'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:49:26.101588 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-22ce720d-66b9-433a-b93f-c1a2fdd799c0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Getting quotas for user e7a738986f87470681c6a578599a089f and project 7184d0f3256344a2af18c639787e538f. Resources: {'key_pairs'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:49:26.170256 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-df7ae95a-9834-4a34-bb55-208a3faa0c70 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:26.179245 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-df7ae95a-9834-4a34-bb55-208a3faa0c70 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1272 microversion: 2.1 time: 0.162493 Jul 18 10:49:26.179840 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 124/251] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:26 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:26.377025 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-22ce720d-66b9-433a-b93f-c1a2fdd799c0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.306635 Jul 18 10:49:26.377643 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 128/252] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 18 10:49:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:49:26.420739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0905354a-f45b-4d2b-a92b-2e2b50a3017a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Action: 'create', calling method: .version_select at 0x7f6364e09a60>, body: {"keypair": {"name": "tempest-keypair-1734778831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbzAbe2cJ8oxsipna20sumkGGbs7VQ8dndy59lM5CHVtCIdZoNfbnK0f3d5nil1dnTZ3LkQFDM4gyQj8NCVmZpSC9pA/JE7UdZKu3BkEsCNNsBWoFCNshBSzViM3/enpg=="}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:26.436332 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-0905354a-f45b-4d2b-a92b-2e2b50a3017a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'key_pairs'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:49:26.440429 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-0905354a-f45b-4d2b-a92b-2e2b50a3017a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for user 3954fd4abf6b4c3a82280c762292a3e7 and project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'key_pairs'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:49:26.624188 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-0905354a-f45b-4d2b-a92b-2e2b50a3017a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.207998 Jul 18 10:49:26.632578 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 125/253] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 18 10:49:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:49:27.043748 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f89cf0a6-e012-4d7d-abb4-eb73d9f23c44 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:27.044601 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f89cf0a6-e012-4d7d-abb4-eb73d9f23c44 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:27.056892 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-47490052-e92f-4ae0-8a37-b3b0c94d2fe7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:27.057745 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-47490052-e92f-4ae0-8a37-b3b0c94d2fe7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:27.080280 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-47490052-e92f-4ae0-8a37-b3b0c94d2fe7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:27.081179 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-47490052-e92f-4ae0-8a37-b3b0c94d2fe7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:27.082483 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-47490052-e92f-4ae0-8a37-b3b0c94d2fe7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:27.083244 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-47490052-e92f-4ae0-8a37-b3b0c94d2fe7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:27.089008 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f89cf0a6-e012-4d7d-abb4-eb73d9f23c44 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:27.089990 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f89cf0a6-e012-4d7d-abb4-eb73d9f23c44 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:27.091785 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f89cf0a6-e012-4d7d-abb4-eb73d9f23c44 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:27.093196 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f89cf0a6-e012-4d7d-abb4-eb73d9f23c44 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:27.800817 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-47490052-e92f-4ae0-8a37-b3b0c94d2fe7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:27.809455 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-47490052-e92f-4ae0-8a37-b3b0c94d2fe7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:27.811506 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-47490052-e92f-4ae0-8a37-b3b0c94d2fe7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:27.813849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-47490052-e92f-4ae0-8a37-b3b0c94d2fe7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.763319 Jul 18 10:49:27.825423 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 126/254] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:27 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:27.825423 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-885c6d16-4cd7-4735-9fdc-d4d0dd6aa0cc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:27.825423 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-885c6d16-4cd7-4735-9fdc-d4d0dd6aa0cc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:27.827575 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-885c6d16-4cd7-4735-9fdc-d4d0dd6aa0cc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:27.828734 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-885c6d16-4cd7-4735-9fdc-d4d0dd6aa0cc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:27.829749 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-885c6d16-4cd7-4735-9fdc-d4d0dd6aa0cc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:27.830400 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-885c6d16-4cd7-4735-9fdc-d4d0dd6aa0cc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:27.833347 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f89cf0a6-e012-4d7d-abb4-eb73d9f23c44 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:27.863309 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f89cf0a6-e012-4d7d-abb4-eb73d9f23c44 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1724 microversion: 2.1 time: 0.833044 Jul 18 10:49:27.866409 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 129/255] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:27 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1724 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:28.256060 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-885c6d16-4cd7-4735-9fdc-d4d0dd6aa0cc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:28.279766 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-885c6d16-4cd7-4735-9fdc-d4d0dd6aa0cc tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1314 microversion: 2.1 time: 0.462880 Jul 18 10:49:28.281482 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 127/256] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:27 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:28.838786 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-536fc985-edb9-453e-96fd-d2074d671507 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:28.838786 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-536fc985-edb9-453e-96fd-d2074d671507 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:28.844290 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-536fc985-edb9-453e-96fd-d2074d671507 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:28.844851 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-536fc985-edb9-453e-96fd-d2074d671507 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:28.846429 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-536fc985-edb9-453e-96fd-d2074d671507 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:28.847076 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-536fc985-edb9-453e-96fd-d2074d671507 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:28.882283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9abee6fa-8328-42af-a428-7e3f453d3857 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:28.883603 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9abee6fa-8328-42af-a428-7e3f453d3857 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:28.896959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9abee6fa-8328-42af-a428-7e3f453d3857 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:28.902750 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9abee6fa-8328-42af-a428-7e3f453d3857 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:28.902750 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9abee6fa-8328-42af-a428-7e3f453d3857 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:28.902750 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9abee6fa-8328-42af-a428-7e3f453d3857 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:29.268932 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-536fc985-edb9-453e-96fd-d2074d671507 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:29.281361 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-536fc985-edb9-453e-96fd-d2074d671507 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:29.288073 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-536fc985-edb9-453e-96fd-d2074d671507 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:29.294554 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-536fc985-edb9-453e-96fd-d2074d671507 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.458817 Jul 18 10:49:29.294554 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 130/257] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:28 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:29.315223 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-858afa0c-3037-47b3-90e8-a96532ae8af2 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:29.316301 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-858afa0c-3037-47b3-90e8-a96532ae8af2 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:29.323435 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-858afa0c-3037-47b3-90e8-a96532ae8af2 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:29.327340 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-858afa0c-3037-47b3-90e8-a96532ae8af2 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:29.327340 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-858afa0c-3037-47b3-90e8-a96532ae8af2 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:29.327340 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-858afa0c-3037-47b3-90e8-a96532ae8af2 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:29.351448 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9abee6fa-8328-42af-a428-7e3f453d3857 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:29.370899 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9abee6fa-8328-42af-a428-7e3f453d3857 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1724 microversion: 2.1 time: 0.490626 Jul 18 10:49:29.376190 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 128/258] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:28 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1724 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:29.794291 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-858afa0c-3037-47b3-90e8-a96532ae8af2 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:29.821794 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-858afa0c-3037-47b3-90e8-a96532ae8af2 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1314 microversion: 2.1 time: 0.511259 Jul 18 10:49:29.822877 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 131/259] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:29 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:30.072016 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-bca0d7c9-e1d8-4b6e-8ee5-df46b49c3531 req-51bc509d-8b1e-448e-9ba7-9b8c93ed7d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5b7479-dfde-46d4-9e99-3926c60cad12", "tag": "5bb19a63-76d3-448c-b73e-662696a94068"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:30.086226 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-bca0d7c9-e1d8-4b6e-8ee5-df46b49c3531 req-51bc509d-8b1e-448e-9ba7-9b8c93ed7d04 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:30.087065 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-bca0d7c9-e1d8-4b6e-8ee5-df46b49c3531 req-51bc509d-8b1e-448e-9ba7-9b8c93ed7d04 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:30.103850 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-bca0d7c9-e1d8-4b6e-8ee5-df46b49c3531 req-51bc509d-8b1e-448e-9ba7-9b8c93ed7d04 service nova] Creating event network-changed:5bb19a63-76d3-448c-b73e-662696a94068 for instance ad5b7479-dfde-46d4-9e99-3926c60cad12 on hv-cinder-84949 Jul 18 10:49:30.112058 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-bca0d7c9-e1d8-4b6e-8ee5-df46b49c3531 req-51bc509d-8b1e-448e-9ba7-9b8c93ed7d04 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045487 Jul 18 10:49:30.113550 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 129/260] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:30.319413 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f628af9a-2e7d-4724-992f-048639b98236 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:30.320958 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f628af9a-2e7d-4724-992f-048639b98236 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:30.343111 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f628af9a-2e7d-4724-992f-048639b98236 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:30.345299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f628af9a-2e7d-4724-992f-048639b98236 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:30.348723 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f628af9a-2e7d-4724-992f-048639b98236 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:30.351066 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f628af9a-2e7d-4724-992f-048639b98236 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:30.418093 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f1eb9df8-a3c1-4a51-b927-a55f25ee8ca1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:30.424297 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f1eb9df8-a3c1-4a51-b927-a55f25ee8ca1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:30.458404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f1eb9df8-a3c1-4a51-b927-a55f25ee8ca1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:30.462926 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f1eb9df8-a3c1-4a51-b927-a55f25ee8ca1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:30.473809 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f1eb9df8-a3c1-4a51-b927-a55f25ee8ca1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:30.475343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f1eb9df8-a3c1-4a51-b927-a55f25ee8ca1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:31.012336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=2 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:31.149892 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f1eb9df8-a3c1-4a51-b927-a55f25ee8ca1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:31.163621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f1eb9df8-a3c1-4a51-b927-a55f25ee8ca1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1724 microversion: 2.1 time: 0.763009 Jul 18 10:49:31.164315 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 130/261] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:30 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1724 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:31.169861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2012534160", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09160d22-0418-499d-83b3-2657454003a1"}], "security_groups": [{"name": "tempest-securitygroup--692141611"}], "key_name": "tempest-keypair-280716380", "user_data": "}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:31.240052 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f628af9a-2e7d-4724-992f-048639b98236 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:31.259213 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f628af9a-2e7d-4724-992f-048639b98236 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:31.261071 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f628af9a-2e7d-4724-992f-048639b98236 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:31.262423 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f628af9a-2e7d-4724-992f-048639b98236 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.954881 Jul 18 10:49:31.262986 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 132/262] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:30 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:31.268610 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a9f8c50d-e8a1-42ad-b4a8-deeea5c91f5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:31.269464 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a9f8c50d-e8a1-42ad-b4a8-deeea5c91f5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:31.276755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a9f8c50d-e8a1-42ad-b4a8-deeea5c91f5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:31.278618 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a9f8c50d-e8a1-42ad-b4a8-deeea5c91f5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:31.279597 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a9f8c50d-e8a1-42ad-b4a8-deeea5c91f5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:31.280028 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a9f8c50d-e8a1-42ad-b4a8-deeea5c91f5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:31.518201 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.network.neutron [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] validate_networks() for [('09160d22-0418-499d-83b3-2657454003a1', None, None, None, None, None)] {{(pid=125007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:49:31.788314 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a9f8c50d-e8a1-42ad-b4a8-deeea5c91f5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:31.809439 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a9f8c50d-e8a1-42ad-b4a8-deeea5c91f5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1314 microversion: 2.1 time: 0.544493 Jul 18 10:49:31.811122 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 133/263] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:31 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:31.819527 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-944628014", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfde60e0-9a8e-4b4d-8a28-cc720005757b"}], "security_groups": [{"name": "tempest-securitygroup--9810965"}], "key_name": "tempest-keypair-1734778831", "user_data": "}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:32.159114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.network.neutron [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] validate_networks() for [('cfde60e0-9a8e-4b4d-8a28-cc720005757b', None, None, None, None, None)] {{(pid=125005) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:49:33.094761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Flavor limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:49:33.095951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Image limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:49:33.096856 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Flavor pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:49:33.097526 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Image pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:49:33.098314 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:49:33.115962 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:33.116807 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:33.118699 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:33.119795 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:33.156299 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Getting quotas for project 7184d0f3256344a2af18c639787e538f. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:49:33.167021 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Getting quotas for user e7a738986f87470681c6a578599a089f and project 7184d0f3256344a2af18c639787e538f. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:49:33.193801 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Going to run 1 instances... {{(pid=125007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:49:33.196225 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:49:33.442846 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d61ba501-9433-4119-bc09-18e1eca780bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.275773 Jul 18 10:49:33.442846 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 131/264] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:49:31 2022] POST /compute/v2.1/servers => generated 408 bytes in 2277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:49:33.446640 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-fa66c775-e1d7-4c79-a1b4-a9e0025886d9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:33.462586 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-fa66c775-e1d7-4c79-a1b4-a9e0025886d9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:33.491836 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fa66c775-e1d7-4c79-a1b4-a9e0025886d9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:33.492010 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fa66c775-e1d7-4c79-a1b4-a9e0025886d9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:33.492746 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fa66c775-e1d7-4c79-a1b4-a9e0025886d9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:33.493226 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fa66c775-e1d7-4c79-a1b4-a9e0025886d9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:33.533169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Flavor limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:49:33.534959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Image limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:49:33.535623 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Flavor pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:49:33.536181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Image pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:49:33.536857 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:49:33.550493 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:33.551391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:33.551696 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:33.551971 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:33.590961 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:49:33.598139 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for user 3954fd4abf6b4c3a82280c762292a3e7 and project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:49:33.634050 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Going to run 1 instances... {{(pid=125005) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:49:33.639964 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125005) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:49:33.792596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-fa66c775-e1d7-4c79-a1b4-a9e0025886d9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:33.816162 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-fa66c775-e1d7-4c79-a1b4-a9e0025886d9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1724 microversion: 2.1 time: 0.371954 Jul 18 10:49:33.817257 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 132/265] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:33 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1724 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:33.822587 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5e1d881b-5713-468d-8c6f-98faa01d1812 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:33.823501 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-5e1d881b-5713-468d-8c6f-98faa01d1812 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:33.846694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5e1d881b-5713-468d-8c6f-98faa01d1812 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:33.848474 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5e1d881b-5713-468d-8c6f-98faa01d1812 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:33.851659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5e1d881b-5713-468d-8c6f-98faa01d1812 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:33.855815 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5e1d881b-5713-468d-8c6f-98faa01d1812 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:33.878880 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-af030bcf-a29b-47e1-bcd5-9364f1b990a1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 2.065195 Jul 18 10:49:33.884228 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 134/266] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:49:31 2022] POST /compute/v2.1/servers => generated 399 bytes in 2072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:49:33.901540 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-360ecb1b-eeb8-41fc-8620-822529e0a6a5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:33.906326 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-360ecb1b-eeb8-41fc-8620-822529e0a6a5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:33.917302 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-360ecb1b-eeb8-41fc-8620-822529e0a6a5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:33.918158 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-360ecb1b-eeb8-41fc-8620-822529e0a6a5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:33.919589 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-360ecb1b-eeb8-41fc-8620-822529e0a6a5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:33.920458 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-360ecb1b-eeb8-41fc-8620-822529e0a6a5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:34.221616 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-360ecb1b-eeb8-41fc-8620-822529e0a6a5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:34.236621 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-360ecb1b-eeb8-41fc-8620-822529e0a6a5 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1314 microversion: 2.1 time: 0.349627 Jul 18 10:49:34.251567 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 135/267] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:33 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:34.265666 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-5e1d881b-5713-468d-8c6f-98faa01d1812 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:34.268587 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5a9e8fb4-0862-4eff-a1d7-4406de0c06d6 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:34.269519 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5a9e8fb4-0862-4eff-a1d7-4406de0c06d6 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:34.291044 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-5e1d881b-5713-468d-8c6f-98faa01d1812 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:34.296482 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-5e1d881b-5713-468d-8c6f-98faa01d1812 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:34.301160 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5e1d881b-5713-468d-8c6f-98faa01d1812 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.482320 Jul 18 10:49:34.304422 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 133/268] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:33 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:34.313316 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9b7e73d4-bec7-4149-a473-fa86460079e5 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:34.313996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9b7e73d4-bec7-4149-a473-fa86460079e5 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:34.330770 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5a9e8fb4-0862-4eff-a1d7-4406de0c06d6 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:34.338288 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5a9e8fb4-0862-4eff-a1d7-4406de0c06d6 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1245 microversion: 2.1 time: 0.075305 Jul 18 10:49:34.339840 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 136/269] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:34 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:34.408267 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9b7e73d4-bec7-4149-a473-fa86460079e5 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:34.416245 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9b7e73d4-bec7-4149-a473-fa86460079e5 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1241 microversion: 2.1 time: 0.110653 Jul 18 10:49:34.416860 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 134/270] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:34 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:34.835151 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-1b9b31bf-0781-4943-ab40-85473af41f77 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:34.835802 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-1b9b31bf-0781-4943-ab40-85473af41f77 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:34.842169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1b9b31bf-0781-4943-ab40-85473af41f77 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:34.842536 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1b9b31bf-0781-4943-ab40-85473af41f77 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:34.844515 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1b9b31bf-0781-4943-ab40-85473af41f77 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:34.844988 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1b9b31bf-0781-4943-ab40-85473af41f77 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:34.863924 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:35.009850 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-1b9b31bf-0781-4943-ab40-85473af41f77 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:35.019456 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-1b9b31bf-0781-4943-ab40-85473af41f77 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1701 microversion: 2.1 time: 0.188265 Jul 18 10:49:35.028102 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 137/271] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:34 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1701 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:35.038509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ecbaa383-5cf6-4a6e-96e9-53b5c3a7cb92 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:35.044992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ecbaa383-5cf6-4a6e-96e9-53b5c3a7cb92 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:35.045438 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ecbaa383-5cf6-4a6e-96e9-53b5c3a7cb92 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:35.070230 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ecbaa383-5cf6-4a6e-96e9-53b5c3a7cb92 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Going to try to start instance {{(pid=125007) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 10:49:35.269549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8a4ccd1c-de14-4a36-b6d3-0c04f5a310d3 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:35.270628 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8a4ccd1c-de14-4a36-b6d3-0c04f5a310d3 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:35.277606 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8a4ccd1c-de14-4a36-b6d3-0c04f5a310d3 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:35.278758 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8a4ccd1c-de14-4a36-b6d3-0c04f5a310d3 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:35.279798 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8a4ccd1c-de14-4a36-b6d3-0c04f5a310d3 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:35.280474 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8a4ccd1c-de14-4a36-b6d3-0c04f5a310d3 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:35.365556 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ecbaa383-5cf6-4a6e-96e9-53b5c3a7cb92 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "POST /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/action" status: 202 len: 0 microversion: 2.1 time: 0.330808 Jul 18 10:49:35.366193 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 135/272] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 18 10:49:35 2022] POST /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:49:35.372519 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-337acadc-20f1-4580-8cd3-38e8ffa3a948 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:35.376411 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-337acadc-20f1-4580-8cd3-38e8ffa3a948 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:35.396152 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-337acadc-20f1-4580-8cd3-38e8ffa3a948 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:35.407448 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-337acadc-20f1-4580-8cd3-38e8ffa3a948 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:35.407448 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-337acadc-20f1-4580-8cd3-38e8ffa3a948 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:35.407448 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-337acadc-20f1-4580-8cd3-38e8ffa3a948 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:35.871842 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8a4ccd1c-de14-4a36-b6d3-0c04f5a310d3 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:35.880814 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8a4ccd1c-de14-4a36-b6d3-0c04f5a310d3 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1314 microversion: 2.1 time: 0.615597 Jul 18 10:49:35.885505 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 138/273] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:35 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:35.896604 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d1e5e103-5b95-4cb2-bb06-49fbfa567358 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:35.897842 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d1e5e103-5b95-4cb2-bb06-49fbfa567358 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:35.912384 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d1e5e103-5b95-4cb2-bb06-49fbfa567358 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:35.919848 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d1e5e103-5b95-4cb2-bb06-49fbfa567358 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:35.924624 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d1e5e103-5b95-4cb2-bb06-49fbfa567358 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:35.925207 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d1e5e103-5b95-4cb2-bb06-49fbfa567358 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:36.088862 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-337acadc-20f1-4580-8cd3-38e8ffa3a948 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:36.107313 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-337acadc-20f1-4580-8cd3-38e8ffa3a948 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:36.109937 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-337acadc-20f1-4580-8cd3-38e8ffa3a948 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:36.111776 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-337acadc-20f1-4580-8cd3-38e8ffa3a948 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.744173 Jul 18 10:49:36.112949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 136/274] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:35 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:36.118361 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d4fbb252-9d1c-423f-a901-8818926547b3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:36.119578 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d4fbb252-9d1c-423f-a901-8818926547b3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:36.142739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d4fbb252-9d1c-423f-a901-8818926547b3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:36.144943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d4fbb252-9d1c-423f-a901-8818926547b3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:36.146435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d4fbb252-9d1c-423f-a901-8818926547b3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:36.148507 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d4fbb252-9d1c-423f-a901-8818926547b3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:36.215754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-d1e5e103-5b95-4cb2-bb06-49fbfa567358 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:36.226084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d1e5e103-5b95-4cb2-bb06-49fbfa567358 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1249 microversion: 2.1 time: 0.339343 Jul 18 10:49:36.229673 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 139/275] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:35 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1249 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:36.241751 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9ee8fd82-522e-469a-882e-8b19886cb43a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:36.242585 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-9ee8fd82-522e-469a-882e-8b19886cb43a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:36.250328 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9ee8fd82-522e-469a-882e-8b19886cb43a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:36.251010 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9ee8fd82-522e-469a-882e-8b19886cb43a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:36.252019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9ee8fd82-522e-469a-882e-8b19886cb43a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:36.252648 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9ee8fd82-522e-469a-882e-8b19886cb43a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:36.408896 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9ee8fd82-522e-469a-882e-8b19886cb43a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:36.451849 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9ee8fd82-522e-469a-882e-8b19886cb43a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1245 microversion: 2.1 time: 0.220304 Jul 18 10:49:36.455250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 140/276] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:36 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1245 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:36.618929 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d4fbb252-9d1c-423f-a901-8818926547b3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:36.631702 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d4fbb252-9d1c-423f-a901-8818926547b3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1710 microversion: 2.1 time: 0.516689 Jul 18 10:49:36.632714 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 137/277] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:36 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1710 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:36.898920 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-567305b3-0faa-4f06-b7b3-3b70ecadc396 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:36.899575 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-567305b3-0faa-4f06-b7b3-3b70ecadc396 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:36.911849 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-567305b3-0faa-4f06-b7b3-3b70ecadc396 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:36.912545 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-567305b3-0faa-4f06-b7b3-3b70ecadc396 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:36.916646 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-567305b3-0faa-4f06-b7b3-3b70ecadc396 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:36.919003 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-567305b3-0faa-4f06-b7b3-3b70ecadc396 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:37.147267 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5e3a07f1-52ab-4675-9141-1477db15aea2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:37.149233 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-5e3a07f1-52ab-4675-9141-1477db15aea2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:37.160753 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5e3a07f1-52ab-4675-9141-1477db15aea2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:37.161673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5e3a07f1-52ab-4675-9141-1477db15aea2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:37.165846 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5e3a07f1-52ab-4675-9141-1477db15aea2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:37.166296 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5e3a07f1-52ab-4675-9141-1477db15aea2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:37.194009 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-567305b3-0faa-4f06-b7b3-3b70ecadc396 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:37.221185 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-567305b3-0faa-4f06-b7b3-3b70ecadc396 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1314 microversion: 2.1 time: 0.324277 Jul 18 10:49:37.225054 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 141/278] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:36 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:37.271075 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c053a442-8380-4356-981c-e4c5234b906b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:37.271701 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c053a442-8380-4356-981c-e4c5234b906b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:37.293717 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c053a442-8380-4356-981c-e4c5234b906b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:37.295803 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c053a442-8380-4356-981c-e4c5234b906b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:37.297765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c053a442-8380-4356-981c-e4c5234b906b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:37.299641 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c053a442-8380-4356-981c-e4c5234b906b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:37.597276 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c053a442-8380-4356-981c-e4c5234b906b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:37.613238 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c053a442-8380-4356-981c-e4c5234b906b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1305 microversion: 2.1 time: 0.354265 Jul 18 10:49:37.613771 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 142/279] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:37 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1305 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:37.621940 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-fc84292c-7c53-4905-ac5e-f23afa1238a6 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:37.622846 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-fc84292c-7c53-4905-ac5e-f23afa1238a6 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:37.629590 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fc84292c-7c53-4905-ac5e-f23afa1238a6 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:37.630543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fc84292c-7c53-4905-ac5e-f23afa1238a6 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:37.631514 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fc84292c-7c53-4905-ac5e-f23afa1238a6 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:37.632199 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fc84292c-7c53-4905-ac5e-f23afa1238a6 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:37.645069 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-5e3a07f1-52ab-4675-9141-1477db15aea2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:37.656691 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-5e3a07f1-52ab-4675-9141-1477db15aea2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:37.658259 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-5e3a07f1-52ab-4675-9141-1477db15aea2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:37.665112 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5e3a07f1-52ab-4675-9141-1477db15aea2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.518821 Jul 18 10:49:37.665814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 138/280] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:37 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:37.679380 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6e192b3c-7b9e-4900-bb13-b9bcb6a95d75 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:37.685757 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6e192b3c-7b9e-4900-bb13-b9bcb6a95d75 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:37.697048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6e192b3c-7b9e-4900-bb13-b9bcb6a95d75 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:37.697883 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6e192b3c-7b9e-4900-bb13-b9bcb6a95d75 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:37.699533 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6e192b3c-7b9e-4900-bb13-b9bcb6a95d75 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:37.700202 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6e192b3c-7b9e-4900-bb13-b9bcb6a95d75 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:37.777413 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-fc84292c-7c53-4905-ac5e-f23afa1238a6 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:37.787230 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-fc84292c-7c53-4905-ac5e-f23afa1238a6 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1293 microversion: 2.1 time: 0.169170 Jul 18 10:49:37.788063 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 143/281] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:37 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1293 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:37.991251 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-6e192b3c-7b9e-4900-bb13-b9bcb6a95d75 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:38.002866 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6e192b3c-7b9e-4900-bb13-b9bcb6a95d75 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1710 microversion: 2.1 time: 0.335966 Jul 18 10:49:38.004044 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 139/282] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:37 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1710 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:38.078578 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-33cba664-768f-4999-8588-ad9ab2d71d02 req-34e9a0cd-96ea-4ddb-85df-9b6fe7ce24c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5b7479-dfde-46d4-9e99-3926c60cad12", "name": "network-vif-plugged", "status": "completed", "tag": "5bb19a63-76d3-448c-b73e-662696a94068"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:38.087301 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-33cba664-768f-4999-8588-ad9ab2d71d02 req-34e9a0cd-96ea-4ddb-85df-9b6fe7ce24c2 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:38.087738 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-33cba664-768f-4999-8588-ad9ab2d71d02 req-34e9a0cd-96ea-4ddb-85df-9b6fe7ce24c2 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:38.100699 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-33cba664-768f-4999-8588-ad9ab2d71d02 req-34e9a0cd-96ea-4ddb-85df-9b6fe7ce24c2 service nova] Creating event network-vif-plugged:5bb19a63-76d3-448c-b73e-662696a94068 for instance ad5b7479-dfde-46d4-9e99-3926c60cad12 on hv-cinder-84949 Jul 18 10:49:38.106313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-33cba664-768f-4999-8588-ad9ab2d71d02 req-34e9a0cd-96ea-4ddb-85df-9b6fe7ce24c2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032169 Jul 18 10:49:38.107078 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 144/283] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:49:38.243651 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-403bad05-b631-4581-867d-4beb82ffc716 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:38.245700 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-403bad05-b631-4581-867d-4beb82ffc716 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:38.258509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-403bad05-b631-4581-867d-4beb82ffc716 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:38.259323 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-403bad05-b631-4581-867d-4beb82ffc716 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:38.260466 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-403bad05-b631-4581-867d-4beb82ffc716 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:38.261321 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-403bad05-b631-4581-867d-4beb82ffc716 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:38.638154 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6890a54f-d4e0-49c5-b88c-4e0e6770f4cc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:38.639027 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-6890a54f-d4e0-49c5-b88c-4e0e6770f4cc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:38.639713 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-403bad05-b631-4581-867d-4beb82ffc716 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:38.649315 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-403bad05-b631-4581-867d-4beb82ffc716 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1314 microversion: 2.1 time: 0.410010 Jul 18 10:49:38.653502 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6890a54f-d4e0-49c5-b88c-4e0e6770f4cc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:38.654239 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6890a54f-d4e0-49c5-b88c-4e0e6770f4cc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:38.656730 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6890a54f-d4e0-49c5-b88c-4e0e6770f4cc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:38.657763 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6890a54f-d4e0-49c5-b88c-4e0e6770f4cc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:38.660731 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 140/284] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:38 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:38.687932 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3eea383c-4489-4f1e-84c4-a5fda275d4fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:38.688620 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3eea383c-4489-4f1e-84c4-a5fda275d4fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:38.695570 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3eea383c-4489-4f1e-84c4-a5fda275d4fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:38.696406 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3eea383c-4489-4f1e-84c4-a5fda275d4fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:38.697426 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3eea383c-4489-4f1e-84c4-a5fda275d4fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:38.698009 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3eea383c-4489-4f1e-84c4-a5fda275d4fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:38.701480 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:38.779583 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6890a54f-d4e0-49c5-b88c-4e0e6770f4cc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:38.791333 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-6890a54f-d4e0-49c5-b88c-4e0e6770f4cc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1303 microversion: 2.1 time: 0.162089 Jul 18 10:49:38.792637 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 145/285] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:38 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1303 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:38.819550 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-67c54b8b-f6f4-4a6d-bfd2-4e107731c550 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:38.820760 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-67c54b8b-f6f4-4a6d-bfd2-4e107731c550 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:38.835153 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-67c54b8b-f6f4-4a6d-bfd2-4e107731c550 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:38.835606 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-67c54b8b-f6f4-4a6d-bfd2-4e107731c550 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:38.836370 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-67c54b8b-f6f4-4a6d-bfd2-4e107731c550 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:38.837034 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-67c54b8b-f6f4-4a6d-bfd2-4e107731c550 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:39.136571 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-67c54b8b-f6f4-4a6d-bfd2-4e107731c550 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:39.149434 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3eea383c-4489-4f1e-84c4-a5fda275d4fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:39.150222 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-67c54b8b-f6f4-4a6d-bfd2-4e107731c550 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1311 microversion: 2.1 time: 0.335098 Jul 18 10:49:39.151280 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 146/286] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:38 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1311 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:39.160014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-13574c9a-e43d-47ee-b876-74278ff35992 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:39.165285 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-13574c9a-e43d-47ee-b876-74278ff35992 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:39.179413 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3eea383c-4489-4f1e-84c4-a5fda275d4fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:39.181780 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3eea383c-4489-4f1e-84c4-a5fda275d4fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:39.184208 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3eea383c-4489-4f1e-84c4-a5fda275d4fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1744 microversion: 2.20 time: 0.500784 Jul 18 10:49:39.189368 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-13574c9a-e43d-47ee-b876-74278ff35992 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:39.191735 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-13574c9a-e43d-47ee-b876-74278ff35992 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:39.196976 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-13574c9a-e43d-47ee-b876-74278ff35992 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:39.202957 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-13574c9a-e43d-47ee-b876-74278ff35992 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:39.203108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 141/287] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:38 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1744 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:39.520649 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-13574c9a-e43d-47ee-b876-74278ff35992 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:39.529085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-13574c9a-e43d-47ee-b876-74278ff35992 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1714 microversion: 2.1 time: 0.375053 Jul 18 10:49:39.529672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 147/288] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:39 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1714 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:39.667654 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-c04d31cd-be4e-45f7-9b39-cb4181f57ba4 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:39.668733 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-c04d31cd-be4e-45f7-9b39-cb4181f57ba4 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:39.675631 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c04d31cd-be4e-45f7-9b39-cb4181f57ba4 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:39.676076 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c04d31cd-be4e-45f7-9b39-cb4181f57ba4 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:39.676884 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c04d31cd-be4e-45f7-9b39-cb4181f57ba4 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:39.677321 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c04d31cd-be4e-45f7-9b39-cb4181f57ba4 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:39.817917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5e7f739e-7aee-422c-b8d7-c4fc6629f0a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:39.818776 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5e7f739e-7aee-422c-b8d7-c4fc6629f0a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:39.837398 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5e7f739e-7aee-422c-b8d7-c4fc6629f0a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:39.841351 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5e7f739e-7aee-422c-b8d7-c4fc6629f0a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:39.843147 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5e7f739e-7aee-422c-b8d7-c4fc6629f0a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:39.843808 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5e7f739e-7aee-422c-b8d7-c4fc6629f0a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:40.196767 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c04d31cd-be4e-45f7-9b39-cb4181f57ba4 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:40.205760 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-c04d31cd-be4e-45f7-9b39-cb4181f57ba4 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1314 microversion: 2.1 time: 0.541940 Jul 18 10:49:40.211199 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 142/289] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:39 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:40.223997 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-bdf5513f-fc9b-48fe-9530-5cbabbafe694 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:40.227211 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-bdf5513f-fc9b-48fe-9530-5cbabbafe694 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:40.245395 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bdf5513f-fc9b-48fe-9530-5cbabbafe694 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:40.245768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bdf5513f-fc9b-48fe-9530-5cbabbafe694 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:40.250777 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5e7f739e-7aee-422c-b8d7-c4fc6629f0a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:40.260490 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5e7f739e-7aee-422c-b8d7-c4fc6629f0a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1370 microversion: 2.1 time: 0.453107 Jul 18 10:49:40.262361 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bdf5513f-fc9b-48fe-9530-5cbabbafe694 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:40.263033 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bdf5513f-fc9b-48fe-9530-5cbabbafe694 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:40.265734 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 148/290] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:39 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1370 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:40.272832 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9e6310bf-287a-4b89-aa83-c083ac0ebc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:40.287863 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-9e6310bf-287a-4b89-aa83-c083ac0ebc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:40.302130 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9e6310bf-287a-4b89-aa83-c083ac0ebc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:40.302663 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9e6310bf-287a-4b89-aa83-c083ac0ebc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:40.303361 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9e6310bf-287a-4b89-aa83-c083ac0ebc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:40.303846 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9e6310bf-287a-4b89-aa83-c083ac0ebc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:40.634250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9e6310bf-287a-4b89-aa83-c083ac0ebc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:40.638477 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-bdf5513f-fc9b-48fe-9530-5cbabbafe694 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:40.650006 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9e6310bf-287a-4b89-aa83-c083ac0ebc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:40.651209 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-bdf5513f-fc9b-48fe-9530-5cbabbafe694 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1364 microversion: 2.1 time: 0.436316 Jul 18 10:49:40.652099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 143/291] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:40 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1364 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:40.653328 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9e6310bf-287a-4b89-aa83-c083ac0ebc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:40.654698 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9e6310bf-287a-4b89-aa83-c083ac0ebc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1744 microversion: 2.20 time: 0.387424 Jul 18 10:49:40.655739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 149/292] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:40 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1744 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:41.230460 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8881a88c-11eb-47bf-a459-dc3500637831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:41.232458 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-8881a88c-11eb-47bf-a459-dc3500637831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:41.245071 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8881a88c-11eb-47bf-a459-dc3500637831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:41.246167 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8881a88c-11eb-47bf-a459-dc3500637831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:41.259463 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8881a88c-11eb-47bf-a459-dc3500637831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:41.260830 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8881a88c-11eb-47bf-a459-dc3500637831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:41.295681 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a6fa7bbf-9a64-4276-96db-08c1fc41ce1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:41.298028 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a6fa7bbf-9a64-4276-96db-08c1fc41ce1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:41.317373 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a6fa7bbf-9a64-4276-96db-08c1fc41ce1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:41.321232 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a6fa7bbf-9a64-4276-96db-08c1fc41ce1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:41.322090 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a6fa7bbf-9a64-4276-96db-08c1fc41ce1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:41.325331 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a6fa7bbf-9a64-4276-96db-08c1fc41ce1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:41.679987 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-8881a88c-11eb-47bf-a459-dc3500637831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:41.693887 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-8881a88c-11eb-47bf-a459-dc3500637831 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1314 microversion: 2.1 time: 0.468996 Jul 18 10:49:41.695025 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a6fa7bbf-9a64-4276-96db-08c1fc41ce1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:41.695195 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 144/293] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:41 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:41.700897 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-1fcd27ac-3725-43f4-9528-d33c87e1d1a6 req-9d7dd6ba-b01c-408b-9ab4-577cbcc93f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d05192-b009-41ab-861b-b66d0352d41e", "name": "network-vif-plugged", "status": "completed", "tag": "abd1fe5c-3f12-4f5e-a659-6f5e05dab0ae"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:41.711715 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a6fa7bbf-9a64-4276-96db-08c1fc41ce1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1370 microversion: 2.1 time: 0.436310 Jul 18 10:49:41.712299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 150/294] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:41 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1370 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:41.719622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a4fe4056-8d3a-4186-b55d-2c43a06d3480 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:41.720730 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a4fe4056-8d3a-4186-b55d-2c43a06d3480 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:41.723155 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-1fcd27ac-3725-43f4-9528-d33c87e1d1a6 req-9d7dd6ba-b01c-408b-9ab4-577cbcc93f17 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:41.723753 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-1fcd27ac-3725-43f4-9528-d33c87e1d1a6 req-9d7dd6ba-b01c-408b-9ab4-577cbcc93f17 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:41.728610 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4fe4056-8d3a-4186-b55d-2c43a06d3480 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:41.729073 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4fe4056-8d3a-4186-b55d-2c43a06d3480 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:41.730413 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4fe4056-8d3a-4186-b55d-2c43a06d3480 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:41.731010 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4fe4056-8d3a-4186-b55d-2c43a06d3480 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:41.738243 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-1fcd27ac-3725-43f4-9528-d33c87e1d1a6 req-9d7dd6ba-b01c-408b-9ab4-577cbcc93f17 service nova] Creating event network-vif-plugged:abd1fe5c-3f12-4f5e-a659-6f5e05dab0ae for instance 14d05192-b009-41ab-861b-b66d0352d41e on hv-cinder-84949 Jul 18 10:49:41.743831 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-1fcd27ac-3725-43f4-9528-d33c87e1d1a6 req-9d7dd6ba-b01c-408b-9ab4-577cbcc93f17 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047061 Jul 18 10:49:41.745293 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 145/295] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:41.757289 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e132d558-c07e-4eec-aca6-a2d7fd018ef3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:41.758024 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-e132d558-c07e-4eec-aca6-a2d7fd018ef3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:41.766780 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e132d558-c07e-4eec-aca6-a2d7fd018ef3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:41.767227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e132d558-c07e-4eec-aca6-a2d7fd018ef3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:41.768000 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e132d558-c07e-4eec-aca6-a2d7fd018ef3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:41.768443 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e132d558-c07e-4eec-aca6-a2d7fd018ef3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:42.193390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e132d558-c07e-4eec-aca6-a2d7fd018ef3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:42.203546 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e132d558-c07e-4eec-aca6-a2d7fd018ef3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:42.206629 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e132d558-c07e-4eec-aca6-a2d7fd018ef3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:42.208061 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e132d558-c07e-4eec-aca6-a2d7fd018ef3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1744 microversion: 2.20 time: 0.459983 Jul 18 10:49:42.222070 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 146/296] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:41 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1744 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:42.238972 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-1c29d6f4-5206-4e8f-93ec-4981c65d3459 req-36e758b9-88fa-42c0-a116-4626096fd1bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a4f543-a994-4897-8ced-5c04fed9ef50", "tag": "3ac1975d-f8dd-432b-8748-aa525919c851"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:42.238972 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:42.238972 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-1c29d6f4-5206-4e8f-93ec-4981c65d3459 req-36e758b9-88fa-42c0-a116-4626096fd1bb service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:42.238972 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-1c29d6f4-5206-4e8f-93ec-4981c65d3459 req-36e758b9-88fa-42c0-a116-4626096fd1bb service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:42.252362 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-1c29d6f4-5206-4e8f-93ec-4981c65d3459 req-36e758b9-88fa-42c0-a116-4626096fd1bb service nova] Creating event network-changed:3ac1975d-f8dd-432b-8748-aa525919c851 for instance 48a4f543-a994-4897-8ced-5c04fed9ef50 on hv-cinder-84949 Jul 18 10:49:42.254045 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a4fe4056-8d3a-4186-b55d-2c43a06d3480 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:42.259797 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-1c29d6f4-5206-4e8f-93ec-4981c65d3459 req-36e758b9-88fa-42c0-a116-4626096fd1bb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035270 Jul 18 10:49:42.261492 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 147/297] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:42.267535 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a4fe4056-8d3a-4186-b55d-2c43a06d3480 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1364 microversion: 2.1 time: 0.553646 Jul 18 10:49:42.268413 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 151/298] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:41 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1364 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:42.715757 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-87ea148c-092e-45e9-85ee-87a21736375f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:42.716601 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-87ea148c-092e-45e9-85ee-87a21736375f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:42.722149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-3ecb45c6-7881-45c5-98ef-b1653d7300ea req-c05c8979-74cb-40c1-b521-c1c006b475eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31366990-97f1-495a-98b8-0ff44a44f7e1", "tag": "d5f49a49-e03e-4d9f-b362-39d74c035041"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:42.732411 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87ea148c-092e-45e9-85ee-87a21736375f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:42.733253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87ea148c-092e-45e9-85ee-87a21736375f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:42.734917 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87ea148c-092e-45e9-85ee-87a21736375f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:42.738271 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87ea148c-092e-45e9-85ee-87a21736375f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:42.740231 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:42.760029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-3ecb45c6-7881-45c5-98ef-b1653d7300ea req-c05c8979-74cb-40c1-b521-c1c006b475eb service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:42.765911 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-3ecb45c6-7881-45c5-98ef-b1653d7300ea req-c05c8979-74cb-40c1-b521-c1c006b475eb service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:42.804323 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-3ecb45c6-7881-45c5-98ef-b1653d7300ea req-c05c8979-74cb-40c1-b521-c1c006b475eb service nova] Creating event network-changed:d5f49a49-e03e-4d9f-b362-39d74c035041 for instance 31366990-97f1-495a-98b8-0ff44a44f7e1 on hv-cinder-84949 Jul 18 10:49:42.819696 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-3ecb45c6-7881-45c5-98ef-b1653d7300ea req-c05c8979-74cb-40c1-b521-c1c006b475eb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102372 Jul 18 10:49:42.821886 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 152/299] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:49:42.838578 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5f6b1b7b-104a-42cc-8df0-6de8c2addaab tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:42.839690 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5f6b1b7b-104a-42cc-8df0-6de8c2addaab tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:42.850714 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5f6b1b7b-104a-42cc-8df0-6de8c2addaab tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:42.851547 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5f6b1b7b-104a-42cc-8df0-6de8c2addaab tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:42.852544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5f6b1b7b-104a-42cc-8df0-6de8c2addaab tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:42.853212 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5f6b1b7b-104a-42cc-8df0-6de8c2addaab tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:43.137240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=2 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:43.347197 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-87ea148c-092e-45e9-85ee-87a21736375f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:43.360697 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-87ea148c-092e-45e9-85ee-87a21736375f tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1499 microversion: 2.1 time: 0.652744 Jul 18 10:49:43.385885 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 148/300] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:42 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1499 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:43.392750 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5f6b1b7b-104a-42cc-8df0-6de8c2addaab tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:43.399430 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-773627e5-74e1-41a7-b987-42c2affacb13 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:43.405485 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-773627e5-74e1-41a7-b987-42c2affacb13 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:43.407254 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5f6b1b7b-104a-42cc-8df0-6de8c2addaab tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1370 microversion: 2.1 time: 0.579619 Jul 18 10:49:43.412349 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 153/301] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:42 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1370 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:43.418746 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f8f30b4a-554d-41a5-a39b-bb887e808599 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:43.421191 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f8f30b4a-554d-41a5-a39b-bb887e808599 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:43.435569 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-773627e5-74e1-41a7-b987-42c2affacb13 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:43.441424 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-773627e5-74e1-41a7-b987-42c2affacb13 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:43.441987 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f8f30b4a-554d-41a5-a39b-bb887e808599 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:43.444590 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-773627e5-74e1-41a7-b987-42c2affacb13 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:43.444719 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f8f30b4a-554d-41a5-a39b-bb887e808599 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:43.448080 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-773627e5-74e1-41a7-b987-42c2affacb13 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:43.448248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f8f30b4a-554d-41a5-a39b-bb887e808599 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:43.448803 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f8f30b4a-554d-41a5-a39b-bb887e808599 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:43.567915 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=2 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:43.948024 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-773627e5-74e1-41a7-b987-42c2affacb13 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:43.969481 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-773627e5-74e1-41a7-b987-42c2affacb13 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:43.977841 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-773627e5-74e1-41a7-b987-42c2affacb13 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:43.980902 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-773627e5-74e1-41a7-b987-42c2affacb13 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.593547 Jul 18 10:49:43.982227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 149/302] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:43 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:44.011729 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f8f30b4a-554d-41a5-a39b-bb887e808599 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:44.020205 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f8f30b4a-554d-41a5-a39b-bb887e808599 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1364 microversion: 2.1 time: 0.611035 Jul 18 10:49:44.030659 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 154/303] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:43 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1364 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:44.429235 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0a33a378-cefb-42d1-b062-e1a2ca8327bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:44.430893 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-0a33a378-cefb-42d1-b062-e1a2ca8327bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:44.441240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=12 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:44.457076 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0a33a378-cefb-42d1-b062-e1a2ca8327bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:44.459733 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0a33a378-cefb-42d1-b062-e1a2ca8327bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:44.467337 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0a33a378-cefb-42d1-b062-e1a2ca8327bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:44.471354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0a33a378-cefb-42d1-b062-e1a2ca8327bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:44.956628 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-0a33a378-cefb-42d1-b062-e1a2ca8327bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:44.965335 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-0a33a378-cefb-42d1-b062-e1a2ca8327bd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1370 microversion: 2.1 time: 0.541392 Jul 18 10:49:44.981270 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 150/304] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:44 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1370 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:45.014470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-91318c87-7646-4fc2-bcef-c34509700917 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:45.014470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-91318c87-7646-4fc2-bcef-c34509700917 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:45.014470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=22 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:45.026042 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-91318c87-7646-4fc2-bcef-c34509700917 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:45.026920 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-91318c87-7646-4fc2-bcef-c34509700917 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:45.027964 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-91318c87-7646-4fc2-bcef-c34509700917 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:45.029385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-91318c87-7646-4fc2-bcef-c34509700917 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:45.043231 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-78678870-d39f-4ba5-8320-7ca4b73b482d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:45.045769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-78678870-d39f-4ba5-8320-7ca4b73b482d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:45.067397 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-78678870-d39f-4ba5-8320-7ca4b73b482d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:45.071064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-78678870-d39f-4ba5-8320-7ca4b73b482d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:45.072402 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-78678870-d39f-4ba5-8320-7ca4b73b482d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:45.078185 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-78678870-d39f-4ba5-8320-7ca4b73b482d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:45.118654 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=100 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:45.698494 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-78678870-d39f-4ba5-8320-7ca4b73b482d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:45.715272 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-78678870-d39f-4ba5-8320-7ca4b73b482d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1364 microversion: 2.1 time: 0.675983 Jul 18 10:49:45.715272 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 151/305] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:45 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1364 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:45.724753 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-91318c87-7646-4fc2-bcef-c34509700917 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:45.730652 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f1ca4a85-a946-4b4e-a078-950027d6f447 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:45.736650 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-91318c87-7646-4fc2-bcef-c34509700917 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:45.737583 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f1ca4a85-a946-4b4e-a078-950027d6f447 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:45.745704 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-91318c87-7646-4fc2-bcef-c34509700917 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:45.755177 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-91318c87-7646-4fc2-bcef-c34509700917 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.747925 Jul 18 10:49:45.755519 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f1ca4a85-a946-4b4e-a078-950027d6f447 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:45.755920 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f1ca4a85-a946-4b4e-a078-950027d6f447 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:45.756712 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f1ca4a85-a946-4b4e-a078-950027d6f447 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:45.757549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 155/306] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:45 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:45.768962 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f1ca4a85-a946-4b4e-a078-950027d6f447 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:45.806911 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f1ca4a85-a946-4b4e-a078-950027d6f447 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Going to try to terminate instance {{(pid=125007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:49:45.983172 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c75e4fba-8a15-4305-aec3-029830635b36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:45.984444 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c75e4fba-8a15-4305-aec3-029830635b36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:45.994850 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c75e4fba-8a15-4305-aec3-029830635b36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:45.997027 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c75e4fba-8a15-4305-aec3-029830635b36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:45.997027 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c75e4fba-8a15-4305-aec3-029830635b36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:45.997027 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c75e4fba-8a15-4305-aec3-029830635b36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:46.324198 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f1ca4a85-a946-4b4e-a078-950027d6f447 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 204 len: 0 microversion: 2.1 time: 0.610035 Jul 18 10:49:46.330408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 152/307] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:49:45 2022] DELETE /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:49:46.347090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9db1b192-31bf-4a45-9507-6b9adb34ba5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:46.348282 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9db1b192-31bf-4a45-9507-6b9adb34ba5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:46.368572 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9db1b192-31bf-4a45-9507-6b9adb34ba5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:46.369526 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9db1b192-31bf-4a45-9507-6b9adb34ba5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:46.376156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9db1b192-31bf-4a45-9507-6b9adb34ba5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:46.381976 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9db1b192-31bf-4a45-9507-6b9adb34ba5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:47.045954 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c75e4fba-8a15-4305-aec3-029830635b36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:47.056526 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9db1b192-31bf-4a45-9507-6b9adb34ba5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:47.058774 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c75e4fba-8a15-4305-aec3-029830635b36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1370 microversion: 2.1 time: 1.079817 Jul 18 10:49:47.059732 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 156/308] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:45 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1370 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:47.065819 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d9570cb3-41cd-45c2-8037-e8262f6da95e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:47.066868 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d9570cb3-41cd-45c2-8037-e8262f6da95e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:47.078050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9db1b192-31bf-4a45-9507-6b9adb34ba5d tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1505 microversion: 2.1 time: 0.740524 Jul 18 10:49:47.078415 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 153/309] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:46 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1505 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:47.082176 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d9570cb3-41cd-45c2-8037-e8262f6da95e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:47.082683 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d9570cb3-41cd-45c2-8037-e8262f6da95e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:47.083513 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d9570cb3-41cd-45c2-8037-e8262f6da95e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:47.084167 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d9570cb3-41cd-45c2-8037-e8262f6da95e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:47.092341 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e262f629-2d3d-4895-a2d3-b1dafce3d0f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:47.093245 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-e262f629-2d3d-4895-a2d3-b1dafce3d0f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:47.101148 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e262f629-2d3d-4895-a2d3-b1dafce3d0f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:47.121383 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e262f629-2d3d-4895-a2d3-b1dafce3d0f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:47.122477 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e262f629-2d3d-4895-a2d3-b1dafce3d0f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:47.123068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e262f629-2d3d-4895-a2d3-b1dafce3d0f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:47.500462 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-d9570cb3-41cd-45c2-8037-e8262f6da95e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:47.520404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d9570cb3-41cd-45c2-8037-e8262f6da95e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1364 microversion: 2.1 time: 0.455938 Jul 18 10:49:47.521278 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 157/310] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:47 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1364 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:47.559817 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e262f629-2d3d-4895-a2d3-b1dafce3d0f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:47.570715 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e262f629-2d3d-4895-a2d3-b1dafce3d0f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:47.580545 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e262f629-2d3d-4895-a2d3-b1dafce3d0f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:47.590357 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e262f629-2d3d-4895-a2d3-b1dafce3d0f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.510695 Jul 18 10:49:47.598203 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 154/311] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:47 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:48.078757 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-27e5a16c-1300-41fe-8dc6-3521538ad934 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:48.080069 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-27e5a16c-1300-41fe-8dc6-3521538ad934 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:48.096914 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a3662376-3eb9-4d8f-b219-ed041acfe742 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:48.100639 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a3662376-3eb9-4d8f-b219-ed041acfe742 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:48.106880 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a3662376-3eb9-4d8f-b219-ed041acfe742 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:48.107329 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a3662376-3eb9-4d8f-b219-ed041acfe742 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:48.108117 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a3662376-3eb9-4d8f-b219-ed041acfe742 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:48.108586 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a3662376-3eb9-4d8f-b219-ed041acfe742 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:48.110255 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-27e5a16c-1300-41fe-8dc6-3521538ad934 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:48.113161 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-27e5a16c-1300-41fe-8dc6-3521538ad934 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:48.114045 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-27e5a16c-1300-41fe-8dc6-3521538ad934 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:48.114490 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-27e5a16c-1300-41fe-8dc6-3521538ad934 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:48.614099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a3662376-3eb9-4d8f-b219-ed041acfe742 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:48.614099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a3662376-3eb9-4d8f-b219-ed041acfe742 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1505 microversion: 2.1 time: 0.508824 Jul 18 10:49:48.614099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 155/312] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:48 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:48.614546 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-22cdb8e3-47b1-4736-a935-3a9bbf39ebe2 req-9ae9139e-3305-4395-9a22-2aa81486efe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a4f543-a994-4897-8ced-5c04fed9ef50", "name": "network-vif-plugged", "status": "completed", "tag": "3ac1975d-f8dd-432b-8748-aa525919c851"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:48.620204 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-22cdb8e3-47b1-4736-a935-3a9bbf39ebe2 req-9ae9139e-3305-4395-9a22-2aa81486efe9 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:48.621119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-22cdb8e3-47b1-4736-a935-3a9bbf39ebe2 req-9ae9139e-3305-4395-9a22-2aa81486efe9 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:48.621258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-27e5a16c-1300-41fe-8dc6-3521538ad934 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:48.629787 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-27e5a16c-1300-41fe-8dc6-3521538ad934 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1370 microversion: 2.1 time: 0.555537 Jul 18 10:49:48.631644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 158/313] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:48 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1370 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:48.637107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-0ce0323a-94b9-4c72-a705-5f6a16283eba tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:48.638025 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-0ce0323a-94b9-4c72-a705-5f6a16283eba tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:48.639282 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-22cdb8e3-47b1-4736-a935-3a9bbf39ebe2 req-9ae9139e-3305-4395-9a22-2aa81486efe9 service nova] Creating event network-vif-plugged:3ac1975d-f8dd-432b-8748-aa525919c851 for instance 48a4f543-a994-4897-8ced-5c04fed9ef50 on hv-cinder-84949 Jul 18 10:49:48.645587 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0ce0323a-94b9-4c72-a705-5f6a16283eba tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:48.645789 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-22cdb8e3-47b1-4736-a935-3a9bbf39ebe2 req-9ae9139e-3305-4395-9a22-2aa81486efe9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042818 Jul 18 10:49:48.646510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0ce0323a-94b9-4c72-a705-5f6a16283eba tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:48.646727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 156/314] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:48.648347 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0ce0323a-94b9-4c72-a705-5f6a16283eba tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:48.649726 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0ce0323a-94b9-4c72-a705-5f6a16283eba tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:48.654865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f0f7c00a-9b0c-45a5-868b-799589cf4ad7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:48.657423 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f0f7c00a-9b0c-45a5-868b-799589cf4ad7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:48.666409 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f0f7c00a-9b0c-45a5-868b-799589cf4ad7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:48.667260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f0f7c00a-9b0c-45a5-868b-799589cf4ad7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:48.668636 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f0f7c00a-9b0c-45a5-868b-799589cf4ad7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:48.669528 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f0f7c00a-9b0c-45a5-868b-799589cf4ad7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:49.158079 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0ce0323a-94b9-4c72-a705-5f6a16283eba tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:49.165615 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f0f7c00a-9b0c-45a5-868b-799589cf4ad7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:49.191303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f0f7c00a-9b0c-45a5-868b-799589cf4ad7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:49.199092 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-0ce0323a-94b9-4c72-a705-5f6a16283eba tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1364 microversion: 2.1 time: 0.566114 Jul 18 10:49:49.207030 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 159/315] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:48 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1364 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:49.208983 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f0f7c00a-9b0c-45a5-868b-799589cf4ad7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:49.228120 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f0f7c00a-9b0c-45a5-868b-799589cf4ad7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.569062 Jul 18 10:49:49.228120 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 157/316] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:48 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:49.522525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-af66754c-a4a6-4451-9efb-0ccd66080894 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Action: 'create', calling method: .version_select at 0x7f636568d550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1612637408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAH4isvdybuMVoAllsIv/0k67zpiU4FgWV2uR85ZSWglUCuetbdEmS6tIs63z4NrUu6fi70A6692owfZAVSx7qKZne0/Af+4BhZqkLKS8uBhZTrFhLDs5IU4S8HQBlq8Q=="}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:49.538761 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-af66754c-a4a6-4451-9efb-0ccd66080894 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Getting quotas for project 17f436162f3a4bd4b3a94f584e7d8782. Resources: {'key_pairs'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:49:49.548083 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-af66754c-a4a6-4451-9efb-0ccd66080894 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Getting quotas for user eb483b1aee944da8910dd7468a0ef4ac and project 17f436162f3a4bd4b3a94f584e7d8782. Resources: {'key_pairs'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:49:49.621146 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-34fc9bb7-a108-423c-a8bf-81cd630ea244 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:49.621787 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-34fc9bb7-a108-423c-a8bf-81cd630ea244 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:49.638350 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-34fc9bb7-a108-423c-a8bf-81cd630ea244 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:49.639210 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-34fc9bb7-a108-423c-a8bf-81cd630ea244 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:49.640563 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-34fc9bb7-a108-423c-a8bf-81cd630ea244 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:49.642881 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-34fc9bb7-a108-423c-a8bf-81cd630ea244 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:49.653694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:49.706272 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-af66754c-a4a6-4451-9efb-0ccd66080894 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.494291 Jul 18 10:49:49.714968 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 160/317] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 18 10:49:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:49.727832 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d25d5349-c493-4249-b2c1-41d3f628f9b8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:49.730662 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d25d5349-c493-4249-b2c1-41d3f628f9b8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:49.752712 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d25d5349-c493-4249-b2c1-41d3f628f9b8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:49.753734 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d25d5349-c493-4249-b2c1-41d3f628f9b8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:49.756196 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d25d5349-c493-4249-b2c1-41d3f628f9b8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:49.757527 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d25d5349-c493-4249-b2c1-41d3f628f9b8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:49.822523 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-34fc9bb7-a108-423c-a8bf-81cd630ea244 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:49.840034 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-34fc9bb7-a108-423c-a8bf-81cd630ea244 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1463 microversion: 2.1 time: 0.224185 Jul 18 10:49:49.845523 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 158/318] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:49 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1463 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:49.851269 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-1464656d-0f06-4c76-b71e-abdfcd30ee1f req-cd59b5b0-c1e8-4b46-bdd3-a1eb03849537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5b7479-dfde-46d4-9e99-3926c60cad12", "name": "network-vif-deleted", "tag": "5bb19a63-76d3-448c-b73e-662696a94068"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:49.879957 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-1464656d-0f06-4c76-b71e-abdfcd30ee1f req-cd59b5b0-c1e8-4b46-bdd3-a1eb03849537 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:49.896849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-1464656d-0f06-4c76-b71e-abdfcd30ee1f req-cd59b5b0-c1e8-4b46-bdd3-a1eb03849537 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:49.915207 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-1464656d-0f06-4c76-b71e-abdfcd30ee1f req-cd59b5b0-c1e8-4b46-bdd3-a1eb03849537 service nova] Creating event network-vif-deleted:5bb19a63-76d3-448c-b73e-662696a94068 for instance ad5b7479-dfde-46d4-9e99-3926c60cad12 on hv-cinder-84949 Jul 18 10:49:49.923495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-1464656d-0f06-4c76-b71e-abdfcd30ee1f req-cd59b5b0-c1e8-4b46-bdd3-a1eb03849537 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075847 Jul 18 10:49:49.924189 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 159/319] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:50.087429 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-d25d5349-c493-4249-b2c1-41d3f628f9b8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:50.115609 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d25d5349-c493-4249-b2c1-41d3f628f9b8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1370 microversion: 2.1 time: 0.396051 Jul 18 10:49:50.115609 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 161/320] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:49 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1370 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:50.227061 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-39c82e50-773b-4f24-8a75-682ddf138966 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:50.227933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-39c82e50-773b-4f24-8a75-682ddf138966 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:50.241557 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-731feca0-6e8c-4f5e-b3a6-f969ca282f43 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:50.242111 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-731feca0-6e8c-4f5e-b3a6-f969ca282f43 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:50.255508 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-731feca0-6e8c-4f5e-b3a6-f969ca282f43 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:50.255960 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-731feca0-6e8c-4f5e-b3a6-f969ca282f43 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:50.256808 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-731feca0-6e8c-4f5e-b3a6-f969ca282f43 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:50.263835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-731feca0-6e8c-4f5e-b3a6-f969ca282f43 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:50.264593 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-39c82e50-773b-4f24-8a75-682ddf138966 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:50.265901 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-39c82e50-773b-4f24-8a75-682ddf138966 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:50.266912 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-39c82e50-773b-4f24-8a75-682ddf138966 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:50.270706 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-39c82e50-773b-4f24-8a75-682ddf138966 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:50.676667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-731feca0-6e8c-4f5e-b3a6-f969ca282f43 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:50.704650 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-39c82e50-773b-4f24-8a75-682ddf138966 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:50.719661 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-731feca0-6e8c-4f5e-b3a6-f969ca282f43 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:50.723906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-39c82e50-773b-4f24-8a75-682ddf138966 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1364 microversion: 2.1 time: 0.502227 Jul 18 10:49:50.725836 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 160/321] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:50 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1364 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:50.730175 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-731feca0-6e8c-4f5e-b3a6-f969ca282f43 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:50.737027 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-7e0ffbfb-bc10-4458-a93b-4ad71fff8c8f req-102c946f-0e58-42d5-b4ff-910fe844caaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31366990-97f1-495a-98b8-0ff44a44f7e1", "name": "network-vif-plugged", "status": "completed", "tag": "d5f49a49-e03e-4d9f-b362-39d74c035041"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:50.745589 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-731feca0-6e8c-4f5e-b3a6-f969ca282f43 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.502315 Jul 18 10:49:50.746352 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 162/322] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:50 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:50.758389 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-7e0ffbfb-bc10-4458-a93b-4ad71fff8c8f req-102c946f-0e58-42d5-b4ff-910fe844caaf service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:50.761444 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-7e0ffbfb-bc10-4458-a93b-4ad71fff8c8f req-102c946f-0e58-42d5-b4ff-910fe844caaf service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:50.781584 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-7e0ffbfb-bc10-4458-a93b-4ad71fff8c8f req-102c946f-0e58-42d5-b4ff-910fe844caaf service nova] Creating event network-vif-plugged:d5f49a49-e03e-4d9f-b362-39d74c035041 for instance 31366990-97f1-495a-98b8-0ff44a44f7e1 on hv-cinder-84949 Jul 18 10:49:50.790949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-7e0ffbfb-bc10-4458-a93b-4ad71fff8c8f req-102c946f-0e58-42d5-b4ff-910fe844caaf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059822 Jul 18 10:49:50.793724 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 161/323] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:50.861271 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-38de1e53-136a-43b6-9a8e-e0cec129cf4c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:50.862300 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-38de1e53-136a-43b6-9a8e-e0cec129cf4c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:50.879285 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-38de1e53-136a-43b6-9a8e-e0cec129cf4c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:50.882246 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-38de1e53-136a-43b6-9a8e-e0cec129cf4c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:50.891845 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-38de1e53-136a-43b6-9a8e-e0cec129cf4c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:50.897100 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-38de1e53-136a-43b6-9a8e-e0cec129cf4c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:51.026287 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-38de1e53-136a-43b6-9a8e-e0cec129cf4c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:51.037853 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-38de1e53-136a-43b6-9a8e-e0cec129cf4c tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1299 microversion: 2.1 time: 0.180281 Jul 18 10:49:51.038322 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 163/324] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:50 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:51.137622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-97ffc783-3555-407e-968f-3579a2da08f8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:51.145455 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-97ffc783-3555-407e-968f-3579a2da08f8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:51.157961 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-97ffc783-3555-407e-968f-3579a2da08f8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:51.158897 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-97ffc783-3555-407e-968f-3579a2da08f8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:51.160996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-97ffc783-3555-407e-968f-3579a2da08f8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:51.161834 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-97ffc783-3555-407e-968f-3579a2da08f8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:51.657439 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-97ffc783-3555-407e-968f-3579a2da08f8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:51.667949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-97ffc783-3555-407e-968f-3579a2da08f8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1370 microversion: 2.1 time: 0.535595 Jul 18 10:49:51.683475 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 162/325] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:51 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1370 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:51.748610 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bfa117ac-9f8c-4768-abc1-1119ab49400b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:51.753984 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-bfa117ac-9f8c-4768-abc1-1119ab49400b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:51.773328 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e2f46ff4-e90d-4361-b3d5-b674e7433755 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:51.781398 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-e2f46ff4-e90d-4361-b3d5-b674e7433755 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:51.790845 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bfa117ac-9f8c-4768-abc1-1119ab49400b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:51.791882 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bfa117ac-9f8c-4768-abc1-1119ab49400b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:51.793314 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bfa117ac-9f8c-4768-abc1-1119ab49400b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:51.794276 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bfa117ac-9f8c-4768-abc1-1119ab49400b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:51.812835 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e2f46ff4-e90d-4361-b3d5-b674e7433755 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:51.813315 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e2f46ff4-e90d-4361-b3d5-b674e7433755 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:51.816704 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e2f46ff4-e90d-4361-b3d5-b674e7433755 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:51.818966 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e2f46ff4-e90d-4361-b3d5-b674e7433755 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:52.394904 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e2f46ff4-e90d-4361-b3d5-b674e7433755 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:52.415096 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e2f46ff4-e90d-4361-b3d5-b674e7433755 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:52.416718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e2f46ff4-e90d-4361-b3d5-b674e7433755 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:52.444369 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e2f46ff4-e90d-4361-b3d5-b674e7433755 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.652346 Jul 18 10:49:52.459521 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 163/326] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:51 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:52.464970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b90b4bd1-e7e2-4a69-b1d0-fab4cdc32995 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:52.465907 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b90b4bd1-e7e2-4a69-b1d0-fab4cdc32995 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:52.477429 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bfa117ac-9f8c-4768-abc1-1119ab49400b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:52.483692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b90b4bd1-e7e2-4a69-b1d0-fab4cdc32995 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:52.484391 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b90b4bd1-e7e2-4a69-b1d0-fab4cdc32995 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:52.485503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b90b4bd1-e7e2-4a69-b1d0-fab4cdc32995 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:52.486226 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b90b4bd1-e7e2-4a69-b1d0-fab4cdc32995 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:52.491638 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-bfa117ac-9f8c-4768-abc1-1119ab49400b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1364 microversion: 2.1 time: 0.751613 Jul 18 10:49:52.492388 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 164/327] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:51 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1364 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:52.555212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b90b4bd1-e7e2-4a69-b1d0-fab4cdc32995 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:52.556809 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b90b4bd1-e7e2-4a69-b1d0-fab4cdc32995 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:52.558486 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-b90b4bd1-e7e2-4a69-b1d0-fab4cdc32995 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lazy-loading 'fault' on Instance uuid ad5b7479-dfde-46d4-9e99-3926c60cad12 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:49:52.660448 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b90b4bd1-e7e2-4a69-b1d0-fab4cdc32995 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e86a3f10b64ef38664013e197782c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ea247cf5a540768bbbc7260b74f11c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:52.691432 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bd8df653-45ac-471c-ae3f-bd4f7fcd187d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:52.692346 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-bd8df653-45ac-471c-ae3f-bd4f7fcd187d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:52.692972 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b90b4bd1-e7e2-4a69-b1d0-fab4cdc32995 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 200 len: 1304 microversion: 2.1 time: 0.230081 Jul 18 10:49:52.693893 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 164/328] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:52 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 1304 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:52.705154 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bd8df653-45ac-471c-ae3f-bd4f7fcd187d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:52.705908 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bd8df653-45ac-471c-ae3f-bd4f7fcd187d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:52.706504 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bd8df653-45ac-471c-ae3f-bd4f7fcd187d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:52.711033 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bd8df653-45ac-471c-ae3f-bd4f7fcd187d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:53.138604 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bd8df653-45ac-471c-ae3f-bd4f7fcd187d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:53.152386 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-bd8df653-45ac-471c-ae3f-bd4f7fcd187d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1563 microversion: 2.1 time: 0.464691 Jul 18 10:49:53.158569 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 165/329] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:52 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1563 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:53.176052 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5f3af43f-8dcb-4281-a639-607c153fadfb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:53.176643 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-5f3af43f-8dcb-4281-a639-607c153fadfb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:53.193160 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5f3af43f-8dcb-4281-a639-607c153fadfb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:53.196934 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5f3af43f-8dcb-4281-a639-607c153fadfb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:53.198128 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5f3af43f-8dcb-4281-a639-607c153fadfb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:53.198761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5f3af43f-8dcb-4281-a639-607c153fadfb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:53.349597 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5f3af43f-8dcb-4281-a639-607c153fadfb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180441 Jul 18 10:49:53.351592 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 165/330] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 18 10:49:53 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:53.469515 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-962c6f9e-5de5-4910-b49b-0fcb859cbb6c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:53.473974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-962c6f9e-5de5-4910-b49b-0fcb859cbb6c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:53.515970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-97b6288f-792a-4edd-84ed-46db7c605905 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:53.516660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-97b6288f-792a-4edd-84ed-46db7c605905 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:53.525681 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-962c6f9e-5de5-4910-b49b-0fcb859cbb6c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:53.526547 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-962c6f9e-5de5-4910-b49b-0fcb859cbb6c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:53.528725 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-962c6f9e-5de5-4910-b49b-0fcb859cbb6c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:53.531032 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-962c6f9e-5de5-4910-b49b-0fcb859cbb6c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:53.541103 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-97b6288f-792a-4edd-84ed-46db7c605905 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:53.542320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-97b6288f-792a-4edd-84ed-46db7c605905 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:53.546586 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-97b6288f-792a-4edd-84ed-46db7c605905 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:53.550061 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-97b6288f-792a-4edd-84ed-46db7c605905 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:54.181647 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-97b6288f-792a-4edd-84ed-46db7c605905 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:54.203026 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-97b6288f-792a-4edd-84ed-46db7c605905 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1364 microversion: 2.1 time: 0.694401 Jul 18 10:49:54.206661 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 166/331] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:53 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1364 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:54.229688 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-05a71236-e4fa-44e9-8ae3-e697f4d30254 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:54.233837 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-05a71236-e4fa-44e9-8ae3-e697f4d30254 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] [instance: ad5b7479-dfde-46d4-9e99-3926c60cad12] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:54.266653 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-05a71236-e4fa-44e9-8ae3-e697f4d30254 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:54.266653 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-05a71236-e4fa-44e9-8ae3-e697f4d30254 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:54.266653 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-05a71236-e4fa-44e9-8ae3-e697f4d30254 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:54.266653 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-05a71236-e4fa-44e9-8ae3-e697f4d30254 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:54.333309 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-05a71236-e4fa-44e9-8ae3-e697f4d30254 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] HTTP exception thrown: Instance ad5b7479-dfde-46d4-9e99-3926c60cad12 could not be found. Jul 18 10:49:54.334074 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-962c6f9e-5de5-4910-b49b-0fcb859cbb6c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-05a71236-e4fa-44e9-8ae3-e697f4d30254 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Request method failure captured: Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 HTTP/1.1 Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1TqR-p1TDnnR6OhImeKzxqzrlE-v5EQSUh8mFCDqWZ413Ct388Emb0RoKXGqn1Nv9Ey9UYEJcnmUlQUgyOxTG9M2Djio8bmymHnsnnaoMiTFGd_uCojtUIdVyR2IrTOGNZik6SqTmfZ4ad6-Amp_aui3e6zhaU09cR98p72qyho_tXg Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: e8ea247cf5a540768bbbc7260b74f11c Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-VolumesActionsTest-2102060617 Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:49:54.339099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:49:54.341979 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e8ea247cf5a540768bbbc7260b74f11c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e8ea247cf5a540768bbbc7260b74f11c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e8ea247cf5a540768bbbc7260b74f11c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e8ea247cf5a540768bbbc7260b74f11c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:49:54.341979 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-VolumesActionsTest-2102060617 Jul 18 10:49:54.341979 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: e8ea247cf5a540768bbbc7260b74f11c Jul 18 10:49:54.341979 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-VolumesActionsTest-2102060617 Jul 18 10:49:54.341979 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-VolumesActionsTest-2102060617-project Jul 18 10:49:54.341979 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:49:54.341979 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:49:54.341979 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 49e86a3f10b64ef38664013e197782c3 Jul 18 10:49:54.341979 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-VolumesActionsTest-2102060617-project Jul 18 10:49:54.341979 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:49:54.341979 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance ad5b7479-dfde-46d4-9e99-3926c60cad12 could not be found. Jul 18 10:49:54.341979 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': 'ad5b7479-dfde-46d4-9e99-3926c60cad12'} Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad5b7479-dfde-46d4-9e99-3926c60cad12 could not be found. Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:49:54.346086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad5b7479-dfde-46d4-9e99-3926c60cad12 could not be found. Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad5b7479-dfde-46d4-9e99-3926c60cad12 could not be found. Jul 18 10:49:54.354053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:49:54.355068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-05a71236-e4fa-44e9-8ae3-e697f4d30254 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] Returning 404 to user: Instance ad5b7479-dfde-46d4-9e99-3926c60cad12 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:49:54.355068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-05a71236-e4fa-44e9-8ae3-e697f4d30254 tempest-VolumesActionsTest-2102060617 tempest-VolumesActionsTest-2102060617-project] 10.222.0.49 "GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12" status: 404 len: 111 microversion: 2.1 time: 0.135061 Jul 18 10:49:54.355068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 167/332] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:54 2022] GET /compute/v2.1/servers/ad5b7479-dfde-46d4-9e99-3926c60cad12 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:49:54.355272 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-962c6f9e-5de5-4910-b49b-0fcb859cbb6c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:54.355272 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-962c6f9e-5de5-4910-b49b-0fcb859cbb6c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:54.355272 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-962c6f9e-5de5-4910-b49b-0fcb859cbb6c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.891949 Jul 18 10:49:54.362915 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 166/333] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:53 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:55.236185 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b6e609ff-93dd-4643-bf75-ce05886666f2 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:55.237871 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b6e609ff-93dd-4643-bf75-ce05886666f2 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:55.247600 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b6e609ff-93dd-4643-bf75-ce05886666f2 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:55.248455 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b6e609ff-93dd-4643-bf75-ce05886666f2 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:55.249857 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b6e609ff-93dd-4643-bf75-ce05886666f2 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:55.250919 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b6e609ff-93dd-4643-bf75-ce05886666f2 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:55.393340 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6c71d403-1320-48f9-be3d-5005213de64b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:55.395515 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-6c71d403-1320-48f9-be3d-5005213de64b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:55.416475 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6c71d403-1320-48f9-be3d-5005213de64b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:55.422086 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6c71d403-1320-48f9-be3d-5005213de64b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:55.426859 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6c71d403-1320-48f9-be3d-5005213de64b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:55.426859 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6c71d403-1320-48f9-be3d-5005213de64b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:55.644263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b6e609ff-93dd-4643-bf75-ce05886666f2 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:55.663639 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b6e609ff-93dd-4643-bf75-ce05886666f2 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1553 microversion: 2.1 time: 0.433708 Jul 18 10:49:55.676861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 168/334] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:55 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1553 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:55.688587 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-573ed9d5-5236-4f2c-adae-e5e49f5cec81 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:55.694586 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-573ed9d5-5236-4f2c-adae-e5e49f5cec81 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:55.708173 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-573ed9d5-5236-4f2c-adae-e5e49f5cec81 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:55.710186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-573ed9d5-5236-4f2c-adae-e5e49f5cec81 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:55.711727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-573ed9d5-5236-4f2c-adae-e5e49f5cec81 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:55.713611 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-573ed9d5-5236-4f2c-adae-e5e49f5cec81 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:55.782569 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6c71d403-1320-48f9-be3d-5005213de64b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:55.794744 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6c71d403-1320-48f9-be3d-5005213de64b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:55.796624 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6c71d403-1320-48f9-be3d-5005213de64b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:55.803730 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-6c71d403-1320-48f9-be3d-5005213de64b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.426111 Jul 18 10:49:55.805297 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 167/335] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:55 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:55.885150 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-573ed9d5-5236-4f2c-adae-e5e49f5cec81 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.206495 Jul 18 10:49:55.887274 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 169/336] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 18 10:49:55 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:56.599393 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-71d28c94-cc35-4dfb-8c5a-f570030a438f req-3340d89a-6b5b-4ec8-9f46-9802f1795bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a4f543-a994-4897-8ced-5c04fed9ef50", "tag": "3ac1975d-f8dd-432b-8748-aa525919c851"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:56.608887 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-71d28c94-cc35-4dfb-8c5a-f570030a438f req-3340d89a-6b5b-4ec8-9f46-9802f1795bdd service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:56.609333 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-71d28c94-cc35-4dfb-8c5a-f570030a438f req-3340d89a-6b5b-4ec8-9f46-9802f1795bdd service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:56.621190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-71d28c94-cc35-4dfb-8c5a-f570030a438f req-3340d89a-6b5b-4ec8-9f46-9802f1795bdd service nova] Creating event network-changed:3ac1975d-f8dd-432b-8748-aa525919c851 for instance 48a4f543-a994-4897-8ced-5c04fed9ef50 on hv-cinder-84949 Jul 18 10:49:56.628853 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-71d28c94-cc35-4dfb-8c5a-f570030a438f req-3340d89a-6b5b-4ec8-9f46-9802f1795bdd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033463 Jul 18 10:49:56.629656 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 168/337] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:49:56.825822 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-96668cab-d260-46c0-b7f6-03b3a9e6cd81 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:56.826518 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-96668cab-d260-46c0-b7f6-03b3a9e6cd81 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:56.834498 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-96668cab-d260-46c0-b7f6-03b3a9e6cd81 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:56.835063 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-96668cab-d260-46c0-b7f6-03b3a9e6cd81 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:56.835988 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-96668cab-d260-46c0-b7f6-03b3a9e6cd81 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:56.836539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-96668cab-d260-46c0-b7f6-03b3a9e6cd81 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:57.198929 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-96668cab-d260-46c0-b7f6-03b3a9e6cd81 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:57.239412 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-96668cab-d260-46c0-b7f6-03b3a9e6cd81 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:57.243523 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-96668cab-d260-46c0-b7f6-03b3a9e6cd81 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:57.246173 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-96668cab-d260-46c0-b7f6-03b3a9e6cd81 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.426129 Jul 18 10:49:57.250923 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 170/338] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:56 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:58.271238 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7e1beb04-d7e7-4c79-91b5-771a97dd47e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:58.272107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-7e1beb04-d7e7-4c79-91b5-771a97dd47e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:58.283576 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7e1beb04-d7e7-4c79-91b5-771a97dd47e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:58.284017 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7e1beb04-d7e7-4c79-91b5-771a97dd47e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:58.296564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7e1beb04-d7e7-4c79-91b5-771a97dd47e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:58.297074 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7e1beb04-d7e7-4c79-91b5-771a97dd47e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:58.708181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7e1beb04-d7e7-4c79-91b5-771a97dd47e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:58.726796 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7e1beb04-d7e7-4c79-91b5-771a97dd47e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:58.741114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7e1beb04-d7e7-4c79-91b5-771a97dd47e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:58.744714 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7e1beb04-d7e7-4c79-91b5-771a97dd47e0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.480272 Jul 18 10:49:58.753498 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 169/339] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:58 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:58.941257 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-f950e25c-12b2-4a15-80ae-df92a55d4cfa req-b27e008e-d5f5-449c-bfa3-8bdbe7cdd0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31366990-97f1-495a-98b8-0ff44a44f7e1", "tag": "d5f49a49-e03e-4d9f-b362-39d74c035041"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:58.953425 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-f950e25c-12b2-4a15-80ae-df92a55d4cfa req-b27e008e-d5f5-449c-bfa3-8bdbe7cdd0f8 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:58.954031 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-f950e25c-12b2-4a15-80ae-df92a55d4cfa req-b27e008e-d5f5-449c-bfa3-8bdbe7cdd0f8 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:58.973003 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-f950e25c-12b2-4a15-80ae-df92a55d4cfa req-b27e008e-d5f5-449c-bfa3-8bdbe7cdd0f8 service nova] Creating event network-changed:d5f49a49-e03e-4d9f-b362-39d74c035041 for instance 31366990-97f1-495a-98b8-0ff44a44f7e1 on hv-cinder-84949 Jul 18 10:49:58.977170 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-f950e25c-12b2-4a15-80ae-df92a55d4cfa req-b27e008e-d5f5-449c-bfa3-8bdbe7cdd0f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040711 Jul 18 10:49:58.977989 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 171/340] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:59.780555 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-cf626c28-2d48-4552-8b55-736bf4e369ca tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:59.782070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-cf626c28-2d48-4552-8b55-736bf4e369ca tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:59.796013 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=4 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:59.809252 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cf626c28-2d48-4552-8b55-736bf4e369ca tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:59.810221 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cf626c28-2d48-4552-8b55-736bf4e369ca tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:59.811957 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cf626c28-2d48-4552-8b55-736bf4e369ca tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:59.812614 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cf626c28-2d48-4552-8b55-736bf4e369ca tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:00.065875 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-cf626c28-2d48-4552-8b55-736bf4e369ca tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:00.078107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-cf626c28-2d48-4552-8b55-736bf4e369ca tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:00.081520 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-cf626c28-2d48-4552-8b55-736bf4e369ca tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:00.083051 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-cf626c28-2d48-4552-8b55-736bf4e369ca tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.312459 Jul 18 10:50:00.094984 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 170/341] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:59 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:01.106983 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a78ed3cb-4895-4fa7-aa88-64cda36e4c1c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:01.108024 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a78ed3cb-4895-4fa7-aa88-64cda36e4c1c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:01.115845 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a78ed3cb-4895-4fa7-aa88-64cda36e4c1c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:01.116413 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a78ed3cb-4895-4fa7-aa88-64cda36e4c1c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:01.117355 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a78ed3cb-4895-4fa7-aa88-64cda36e4c1c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:01.118010 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a78ed3cb-4895-4fa7-aa88-64cda36e4c1c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:01.648821 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a78ed3cb-4895-4fa7-aa88-64cda36e4c1c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:01.669417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a78ed3cb-4895-4fa7-aa88-64cda36e4c1c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:01.674081 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a78ed3cb-4895-4fa7-aa88-64cda36e4c1c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:01.677903 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a78ed3cb-4895-4fa7-aa88-64cda36e4c1c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.576627 Jul 18 10:50:01.682935 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 172/342] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:01 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:02.703197 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-91b61623-2839-4f37-a2bb-f15cd1ce1449 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:02.704039 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-91b61623-2839-4f37-a2bb-f15cd1ce1449 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:02.720981 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-91b61623-2839-4f37-a2bb-f15cd1ce1449 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:02.730849 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-91b61623-2839-4f37-a2bb-f15cd1ce1449 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:02.732471 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-91b61623-2839-4f37-a2bb-f15cd1ce1449 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:02.736745 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-91b61623-2839-4f37-a2bb-f15cd1ce1449 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:02.966503 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-91b61623-2839-4f37-a2bb-f15cd1ce1449 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:02.976356 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-91b61623-2839-4f37-a2bb-f15cd1ce1449 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:02.979400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-91b61623-2839-4f37-a2bb-f15cd1ce1449 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:02.979400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-91b61623-2839-4f37-a2bb-f15cd1ce1449 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.281478 Jul 18 10:50:02.980026 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 171/343] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:02 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:04.001771 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-92352597-a7f7-4114-aa75-befd5ed084be tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:04.003168 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-92352597-a7f7-4114-aa75-befd5ed084be tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:04.019199 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-92352597-a7f7-4114-aa75-befd5ed084be tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:04.019957 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-92352597-a7f7-4114-aa75-befd5ed084be tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:04.021845 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-92352597-a7f7-4114-aa75-befd5ed084be tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:04.024861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-92352597-a7f7-4114-aa75-befd5ed084be tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:04.364377 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-92352597-a7f7-4114-aa75-befd5ed084be tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:04.378748 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-92352597-a7f7-4114-aa75-befd5ed084be tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:04.381316 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-92352597-a7f7-4114-aa75-befd5ed084be tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:04.382639 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-92352597-a7f7-4114-aa75-befd5ed084be tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.385832 Jul 18 10:50:04.383922 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 173/344] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:03 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:05.403047 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-18b6d0bc-bd1a-44da-961f-e7666ae10994 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:05.403611 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-18b6d0bc-bd1a-44da-961f-e7666ae10994 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:05.410526 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18b6d0bc-bd1a-44da-961f-e7666ae10994 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:05.411033 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18b6d0bc-bd1a-44da-961f-e7666ae10994 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:05.411797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18b6d0bc-bd1a-44da-961f-e7666ae10994 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:05.412257 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18b6d0bc-bd1a-44da-961f-e7666ae10994 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:05.637964 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-18b6d0bc-bd1a-44da-961f-e7666ae10994 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:05.665969 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-18b6d0bc-bd1a-44da-961f-e7666ae10994 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:05.668252 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-18b6d0bc-bd1a-44da-961f-e7666ae10994 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:05.672899 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-18b6d0bc-bd1a-44da-961f-e7666ae10994 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.271476 Jul 18 10:50:05.672899 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 172/345] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:05 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:06.693037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-326b2cd9-74cf-41f1-9751-bf75fbdd540e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:06.706433 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-326b2cd9-74cf-41f1-9751-bf75fbdd540e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:06.734409 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-326b2cd9-74cf-41f1-9751-bf75fbdd540e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:06.740821 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-326b2cd9-74cf-41f1-9751-bf75fbdd540e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:06.742747 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-326b2cd9-74cf-41f1-9751-bf75fbdd540e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:06.743400 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-326b2cd9-74cf-41f1-9751-bf75fbdd540e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:07.728566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-326b2cd9-74cf-41f1-9751-bf75fbdd540e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:07.770885 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-326b2cd9-74cf-41f1-9751-bf75fbdd540e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:07.785411 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-326b2cd9-74cf-41f1-9751-bf75fbdd540e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:07.787624 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-326b2cd9-74cf-41f1-9751-bf75fbdd540e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 1.100421 Jul 18 10:50:07.807650 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 174/346] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:06 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:08.817871 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bc76525f-9fd5-419f-88ee-4072d77039da tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:08.819475 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-bc76525f-9fd5-419f-88ee-4072d77039da tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:08.834414 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bc76525f-9fd5-419f-88ee-4072d77039da tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:08.836150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bc76525f-9fd5-419f-88ee-4072d77039da tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:08.837758 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bc76525f-9fd5-419f-88ee-4072d77039da tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:08.838526 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bc76525f-9fd5-419f-88ee-4072d77039da tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:09.342498 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bc76525f-9fd5-419f-88ee-4072d77039da tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:09.342498 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=100 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:09.349513 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bc76525f-9fd5-419f-88ee-4072d77039da tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:09.351470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bc76525f-9fd5-419f-88ee-4072d77039da tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:09.353486 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-bc76525f-9fd5-419f-88ee-4072d77039da tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.543170 Jul 18 10:50:09.354880 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 173/347] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:08 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:10.398364 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-73d43c5c-d239-4a6b-a783-ac4edf341143 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:10.410047 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-73d43c5c-d239-4a6b-a783-ac4edf341143 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:10.438961 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-73d43c5c-d239-4a6b-a783-ac4edf341143 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:10.440434 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-73d43c5c-d239-4a6b-a783-ac4edf341143 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:10.442215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-73d43c5c-d239-4a6b-a783-ac4edf341143 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:10.445010 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-73d43c5c-d239-4a6b-a783-ac4edf341143 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:10.730871 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-73d43c5c-d239-4a6b-a783-ac4edf341143 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:10.743197 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-73d43c5c-d239-4a6b-a783-ac4edf341143 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:10.756858 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-73d43c5c-d239-4a6b-a783-ac4edf341143 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:10.758128 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-73d43c5c-d239-4a6b-a783-ac4edf341143 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.377299 Jul 18 10:50:10.760215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 175/348] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:10 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:11.797410 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8eb355ee-b724-45dd-89e4-c7598b169e7b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:11.803968 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8eb355ee-b724-45dd-89e4-c7598b169e7b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:11.854641 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8eb355ee-b724-45dd-89e4-c7598b169e7b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:11.860984 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8eb355ee-b724-45dd-89e4-c7598b169e7b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:11.862627 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8eb355ee-b724-45dd-89e4-c7598b169e7b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:11.866473 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8eb355ee-b724-45dd-89e4-c7598b169e7b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:12.322537 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8eb355ee-b724-45dd-89e4-c7598b169e7b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:12.332225 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8eb355ee-b724-45dd-89e4-c7598b169e7b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:12.333830 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8eb355ee-b724-45dd-89e4-c7598b169e7b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:12.335284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8eb355ee-b724-45dd-89e4-c7598b169e7b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.548744 Jul 18 10:50:12.335853 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 174/349] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:11 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:13.357067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-c39e8587-b7e2-4f85-98b4-f1c4cb6ade62 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:13.358486 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-c39e8587-b7e2-4f85-98b4-f1c4cb6ade62 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:13.372754 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c39e8587-b7e2-4f85-98b4-f1c4cb6ade62 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:13.374815 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c39e8587-b7e2-4f85-98b4-f1c4cb6ade62 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:13.375870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c39e8587-b7e2-4f85-98b4-f1c4cb6ade62 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:13.376492 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c39e8587-b7e2-4f85-98b4-f1c4cb6ade62 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:13.800377 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c39e8587-b7e2-4f85-98b4-f1c4cb6ade62 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:13.809811 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c39e8587-b7e2-4f85-98b4-f1c4cb6ade62 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:13.812717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c39e8587-b7e2-4f85-98b4-f1c4cb6ade62 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:13.817371 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-c39e8587-b7e2-4f85-98b4-f1c4cb6ade62 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.464528 Jul 18 10:50:13.818556 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 176/350] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:13 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:14.839866 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9955c3bc-a872-42ab-99d3-edd922d6fc46 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:14.841220 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-9955c3bc-a872-42ab-99d3-edd922d6fc46 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:14.849552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9955c3bc-a872-42ab-99d3-edd922d6fc46 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:14.850280 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9955c3bc-a872-42ab-99d3-edd922d6fc46 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:14.851256 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9955c3bc-a872-42ab-99d3-edd922d6fc46 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:14.851940 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9955c3bc-a872-42ab-99d3-edd922d6fc46 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:15.161769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9955c3bc-a872-42ab-99d3-edd922d6fc46 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:15.181392 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9955c3bc-a872-42ab-99d3-edd922d6fc46 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:15.185188 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9955c3bc-a872-42ab-99d3-edd922d6fc46 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:15.187595 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9955c3bc-a872-42ab-99d3-edd922d6fc46 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1739 microversion: 2.20 time: 0.353263 Jul 18 10:50:15.188876 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 175/351] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:14 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1739 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:15.421249 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e3de16f5-6a43-408d-87e3-c32f624ec4d4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Action: 'create', calling method: .version_select at 0x7f6364d4daf0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1160011770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPfTPnbEp6Egeqwl4Hxc1AC8WsX9LBMuPr0y+lHDcghZ4y0bMYKgUvrPoY277WMrSZK0N84WAdneJSAAb25HPXh3Uc9kYfS9xknK8jAa7GW6/U3jERhgumq7I/sqltqZw=="}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:15.427255 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:15.442378 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-e3de16f5-6a43-408d-87e3-c32f624ec4d4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Getting quotas for project 7f36b12884cc423988d28fdcbdb1d8f9. Resources: {'key_pairs'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:50:15.447862 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-e3de16f5-6a43-408d-87e3-c32f624ec4d4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Getting quotas for user 926d4c4971f1425b98aa5828f802fb21 and project 7f36b12884cc423988d28fdcbdb1d8f9. Resources: {'key_pairs'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:50:15.547844 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e3de16f5-6a43-408d-87e3-c32f624ec4d4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.481167 Jul 18 10:50:15.548827 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 177/352] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 18 10:50:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:16.208178 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5b48263b-2175-4415-b473-9cce46abefa3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:16.209080 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5b48263b-2175-4415-b473-9cce46abefa3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:16.211160 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:16.239303 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5b48263b-2175-4415-b473-9cce46abefa3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:16.240430 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5b48263b-2175-4415-b473-9cce46abefa3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:16.257935 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5b48263b-2175-4415-b473-9cce46abefa3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:16.257935 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5b48263b-2175-4415-b473-9cce46abefa3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:16.533528 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5b48263b-2175-4415-b473-9cce46abefa3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:16.546965 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5b48263b-2175-4415-b473-9cce46abefa3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:16.548754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5b48263b-2175-4415-b473-9cce46abefa3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:16.550102 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5b48263b-2175-4415-b473-9cce46abefa3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1721 microversion: 2.20 time: 0.346099 Jul 18 10:50:16.550764 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 176/353] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:16 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1721 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:17.573544 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-110cc7cb-ecb4-408c-bbea-5feed326311b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:17.574989 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-110cc7cb-ecb4-408c-bbea-5feed326311b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:17.583810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-110cc7cb-ecb4-408c-bbea-5feed326311b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:17.584542 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-110cc7cb-ecb4-408c-bbea-5feed326311b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:17.585732 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-110cc7cb-ecb4-408c-bbea-5feed326311b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:17.587005 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-110cc7cb-ecb4-408c-bbea-5feed326311b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:17.862023 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-110cc7cb-ecb4-408c-bbea-5feed326311b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:17.864878 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=100 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:17.874614 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-110cc7cb-ecb4-408c-bbea-5feed326311b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:17.878245 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-110cc7cb-ecb4-408c-bbea-5feed326311b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:17.880948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-110cc7cb-ecb4-408c-bbea-5feed326311b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1721 microversion: 2.20 time: 0.313030 Jul 18 10:50:17.896091 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 178/354] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:17 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1721 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:18.901798 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3d4fd8a3-7c00-43bc-9771-63cebe589fad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:18.907332 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3d4fd8a3-7c00-43bc-9771-63cebe589fad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:18.916397 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3d4fd8a3-7c00-43bc-9771-63cebe589fad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:18.917275 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3d4fd8a3-7c00-43bc-9771-63cebe589fad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:18.918347 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3d4fd8a3-7c00-43bc-9771-63cebe589fad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:18.919078 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3d4fd8a3-7c00-43bc-9771-63cebe589fad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:19.322525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3d4fd8a3-7c00-43bc-9771-63cebe589fad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:19.339479 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3d4fd8a3-7c00-43bc-9771-63cebe589fad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:19.345435 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3d4fd8a3-7c00-43bc-9771-63cebe589fad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:19.349785 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3d4fd8a3-7c00-43bc-9771-63cebe589fad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1721 microversion: 2.20 time: 0.450060 Jul 18 10:50:19.350327 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 177/355] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:18 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1721 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:19.906835 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-52c67c90-a084-4ad3-92b2-a04b2c3562eb req-255f830f-e2cf-4ff0-ac93-9caa32ccfe84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d05192-b009-41ab-861b-b66d0352d41e", "name": "network-vif-unplugged", "status": "completed", "tag": "abd1fe5c-3f12-4f5e-a659-6f5e05dab0ae"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:19.929705 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-52c67c90-a084-4ad3-92b2-a04b2c3562eb req-255f830f-e2cf-4ff0-ac93-9caa32ccfe84 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:19.932863 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-52c67c90-a084-4ad3-92b2-a04b2c3562eb req-255f830f-e2cf-4ff0-ac93-9caa32ccfe84 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:19.965390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-52c67c90-a084-4ad3-92b2-a04b2c3562eb req-255f830f-e2cf-4ff0-ac93-9caa32ccfe84 service nova] Creating event network-vif-unplugged:abd1fe5c-3f12-4f5e-a659-6f5e05dab0ae for instance 14d05192-b009-41ab-861b-b66d0352d41e on hv-cinder-84949 Jul 18 10:50:19.971583 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-52c67c90-a084-4ad3-92b2-a04b2c3562eb req-255f830f-e2cf-4ff0-ac93-9caa32ccfe84 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070167 Jul 18 10:50:19.972491 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 179/356] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:20.380239 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-ba99d8dc-f587-4865-92db-04412012b431 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:20.381532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-ba99d8dc-f587-4865-92db-04412012b431 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:20.393478 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ba99d8dc-f587-4865-92db-04412012b431 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:20.394222 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ba99d8dc-f587-4865-92db-04412012b431 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:20.395472 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ba99d8dc-f587-4865-92db-04412012b431 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:20.396048 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ba99d8dc-f587-4865-92db-04412012b431 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:20.689086 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ba99d8dc-f587-4865-92db-04412012b431 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:20.706331 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ba99d8dc-f587-4865-92db-04412012b431 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:20.714181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ba99d8dc-f587-4865-92db-04412012b431 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:20.714181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-ba99d8dc-f587-4865-92db-04412012b431 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1664 microversion: 2.20 time: 0.337363 Jul 18 10:50:20.736685 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 178/357] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:20 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1664 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:20.745659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8c735f15-29be-4b0d-8a5e-71a633f945f7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0691165f-90e2-4267-902e-84850ba38df0"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:20.746718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-8c735f15-29be-4b0d-8a5e-71a633f945f7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:20.755689 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8c735f15-29be-4b0d-8a5e-71a633f945f7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:20.756139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8c735f15-29be-4b0d-8a5e-71a633f945f7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:20.756979 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8c735f15-29be-4b0d-8a5e-71a633f945f7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:20.757421 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8c735f15-29be-4b0d-8a5e-71a633f945f7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:21.960122 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1942993215", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1612637408", "security_groups": [{"name": "tempest-secgroup-smoke-1718855347"}], "block_device_mapping_v2": [{"uuid": "202895e8-5a9b-4dec-84bf-3e534f8ca5fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "407e895d-8435-43cb-addb-b40e755d1f02"}]}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:22.170600 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.network.neutron [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] validate_networks() for [('407e895d-8435-43cb-addb-b40e755d1f02', None, None, None, None, None)] {{(pid=125005) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:50:22.470337 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-8c735f15-29be-4b0d-8a5e-71a633f945f7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "POST /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.729640 Jul 18 10:50:22.472364 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 180/358] 10.222.0.49 () {62 vars in 1363 bytes} [Mon Jul 18 10:50:20 2022] POST /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/os-volume_attachments => generated 188 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:50:22.738989 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-81d2cfd3-0da4-4533-9577-7b249c08d216 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:22.739930 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-81d2cfd3-0da4-4533-9577-7b249c08d216 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:22.747794 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-81d2cfd3-0da4-4533-9577-7b249c08d216 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:22.749276 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-81d2cfd3-0da4-4533-9577-7b249c08d216 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:22.750449 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-81d2cfd3-0da4-4533-9577-7b249c08d216 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:22.751246 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-81d2cfd3-0da4-4533-9577-7b249c08d216 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:22.775994 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Flavor limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:50:22.776635 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Image limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:50:22.776911 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Flavor pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:50:22.777484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Image pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:50:22.778076 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:50:22.789352 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:22.790106 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:22.791090 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:22.791718 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:22.826413 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Getting quotas for project 17f436162f3a4bd4b3a94f584e7d8782. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:50:22.831741 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Getting quotas for user eb483b1aee944da8910dd7468a0ef4ac and project 17f436162f3a4bd4b3a94f584e7d8782. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:50:22.920699 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Going to run 1 instances... {{(pid=125005) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:50:22.920699 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='202895e8-5a9b-4dec-84bf-3e534f8ca5fd',volume_size=None,volume_type=None)] {{(pid=125005) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:50:23.107811 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-81d2cfd3-0da4-4533-9577-7b249c08d216 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "POST /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/action" status: 202 len: 0 microversion: 2.20 time: 0.380981 Jul 18 10:50:23.109039 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 181/359] 10.222.0.49 () {62 vars in 1318 bytes} [Mon Jul 18 10:50:22 2022] POST /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 10:50:23.117399 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-7a25e927-cd59-4388-a09c-50b7b790ec1b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:23.118229 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-7a25e927-cd59-4388-a09c-50b7b790ec1b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:23.127481 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7a25e927-cd59-4388-a09c-50b7b790ec1b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:23.128565 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7a25e927-cd59-4388-a09c-50b7b790ec1b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:23.130208 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7a25e927-cd59-4388-a09c-50b7b790ec1b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:23.131311 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7a25e927-cd59-4388-a09c-50b7b790ec1b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:23.371938 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7a25e927-cd59-4388-a09c-50b7b790ec1b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:23.388558 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7a25e927-cd59-4388-a09c-50b7b790ec1b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:23.391750 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7a25e927-cd59-4388-a09c-50b7b790ec1b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:23.393694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-7a25e927-cd59-4388-a09c-50b7b790ec1b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1750 microversion: 2.20 time: 0.280173 Jul 18 10:50:23.394690 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 182/360] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:23 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1750 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:23.534676 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5dfdabb5-07b5-4589-8451-b1a7423c59fe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.579011 Jul 18 10:50:23.542562 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 179/361] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:50:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:50:23.548711 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-15b4cb15-8728-468d-956a-10b2df32175d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:23.549591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-15b4cb15-8728-468d-956a-10b2df32175d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:23.618730 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-15b4cb15-8728-468d-956a-10b2df32175d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:23.627486 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-15b4cb15-8728-468d-956a-10b2df32175d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1095 microversion: 2.1 time: 0.083588 Jul 18 10:50:23.628147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 183/362] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:23 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1095 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:24.447858 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3bd9a6b1-9759-41c1-94ed-1b1e79757bfd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:24.447858 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3bd9a6b1-9759-41c1-94ed-1b1e79757bfd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:24.447858 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3bd9a6b1-9759-41c1-94ed-1b1e79757bfd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:24.447858 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3bd9a6b1-9759-41c1-94ed-1b1e79757bfd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:24.448365 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3bd9a6b1-9759-41c1-94ed-1b1e79757bfd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:24.448365 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3bd9a6b1-9759-41c1-94ed-1b1e79757bfd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:24.649751 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-da9e37b4-9d96-48cd-a059-b075204d0994 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:24.650610 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-da9e37b4-9d96-48cd-a059-b075204d0994 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:24.717446 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3bd9a6b1-9759-41c1-94ed-1b1e79757bfd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:24.721534 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3bd9a6b1-9759-41c1-94ed-1b1e79757bfd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:24.726394 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3bd9a6b1-9759-41c1-94ed-1b1e79757bfd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:24.726394 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3bd9a6b1-9759-41c1-94ed-1b1e79757bfd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1750 microversion: 2.20 time: 0.312347 Jul 18 10:50:24.737091 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 180/363] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:24 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1750 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:24.767295 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-da9e37b4-9d96-48cd-a059-b075204d0994 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:24.775850 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-da9e37b4-9d96-48cd-a059-b075204d0994 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1095 microversion: 2.1 time: 0.133070 Jul 18 10:50:24.776606 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 184/364] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:24 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1095 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:25.744763 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6f121233-62be-4bda-b715-81560af50684 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:25.745429 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-6f121233-62be-4bda-b715-81560af50684 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:25.753514 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6f121233-62be-4bda-b715-81560af50684 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:25.753915 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6f121233-62be-4bda-b715-81560af50684 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:25.755483 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6f121233-62be-4bda-b715-81560af50684 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:25.756073 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6f121233-62be-4bda-b715-81560af50684 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:25.801231 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3f9e4bbc-7593-4b38-99d0-ae88cc5acca3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:25.802790 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3f9e4bbc-7593-4b38-99d0-ae88cc5acca3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:25.820577 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3f9e4bbc-7593-4b38-99d0-ae88cc5acca3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:25.821414 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3f9e4bbc-7593-4b38-99d0-ae88cc5acca3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:25.822393 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3f9e4bbc-7593-4b38-99d0-ae88cc5acca3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:25.822989 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3f9e4bbc-7593-4b38-99d0-ae88cc5acca3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:25.943901 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3f9e4bbc-7593-4b38-99d0-ae88cc5acca3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:25.956338 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3f9e4bbc-7593-4b38-99d0-ae88cc5acca3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1137 microversion: 2.1 time: 0.165353 Jul 18 10:50:25.957413 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 185/365] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:25 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1137 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:26.060355 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6f121233-62be-4bda-b715-81560af50684 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:26.071714 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6f121233-62be-4bda-b715-81560af50684 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:26.074109 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6f121233-62be-4bda-b715-81560af50684 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:26.075556 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-6f121233-62be-4bda-b715-81560af50684 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1750 microversion: 2.20 time: 0.335113 Jul 18 10:50:26.088081 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 181/366] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:25 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1750 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:26.991890 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8f1a63ce-549b-4fcf-ac35-a102e1945038 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:26.993155 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-8f1a63ce-549b-4fcf-ac35-a102e1945038 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:27.020479 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f1a63ce-549b-4fcf-ac35-a102e1945038 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:27.034065 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f1a63ce-549b-4fcf-ac35-a102e1945038 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:27.034065 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f1a63ce-549b-4fcf-ac35-a102e1945038 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:27.034065 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f1a63ce-549b-4fcf-ac35-a102e1945038 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:27.100905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-07401aef-8a82-4cb1-80d4-81434ab753a2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:27.101719 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-07401aef-8a82-4cb1-80d4-81434ab753a2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:27.121706 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-07401aef-8a82-4cb1-80d4-81434ab753a2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:27.123668 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-07401aef-8a82-4cb1-80d4-81434ab753a2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:27.126869 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-07401aef-8a82-4cb1-80d4-81434ab753a2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:27.128688 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-07401aef-8a82-4cb1-80d4-81434ab753a2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:27.200108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-8f1a63ce-549b-4fcf-ac35-a102e1945038 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:27.212490 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-8f1a63ce-549b-4fcf-ac35-a102e1945038 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1201 microversion: 2.1 time: 0.225052 Jul 18 10:50:27.213842 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 186/367] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:26 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1201 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:27.429544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-07401aef-8a82-4cb1-80d4-81434ab753a2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:27.446254 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-07401aef-8a82-4cb1-80d4-81434ab753a2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:27.446254 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-07401aef-8a82-4cb1-80d4-81434ab753a2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:27.446254 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-07401aef-8a82-4cb1-80d4-81434ab753a2 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1750 microversion: 2.20 time: 0.350639 Jul 18 10:50:27.447066 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 182/368] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:27 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1750 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:27.762351 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-996f0a35-f461-406e-9aa7-2b353fa96209 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:27.763173 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-996f0a35-f461-406e-9aa7-2b353fa96209 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:27.770249 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-996f0a35-f461-406e-9aa7-2b353fa96209 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:27.770890 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-996f0a35-f461-406e-9aa7-2b353fa96209 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:27.772065 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-996f0a35-f461-406e-9aa7-2b353fa96209 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:27.772570 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-996f0a35-f461-406e-9aa7-2b353fa96209 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:27.986491 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-996f0a35-f461-406e-9aa7-2b353fa96209 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lazy-loading 'services' on Instance uuid 0f96ccdd-67b5-403c-a3b9-8022e271690c {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:50:28.240397 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-63a64d8c-7a4d-40df-8159-9352e8db2a4e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:28.245969 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-63a64d8c-7a4d-40df-8159-9352e8db2a4e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:28.280209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-63a64d8c-7a4d-40df-8159-9352e8db2a4e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:28.282474 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-63a64d8c-7a4d-40df-8159-9352e8db2a4e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:28.284899 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-63a64d8c-7a4d-40df-8159-9352e8db2a4e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:28.287196 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-63a64d8c-7a4d-40df-8159-9352e8db2a4e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:28.299558 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-996f0a35-f461-406e-9aa7-2b353fa96209 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/os-volume_attachments/13041eed-ddc9-49b3-b62a-ffb862a2fb9c" status: 202 len: 0 microversion: 2.1 time: 0.541580 Jul 18 10:50:28.303121 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 187/369] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 18 10:50:27 2022] DELETE /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/os-volume_attachments/13041eed-ddc9-49b3-b62a-ffb862a2fb9c => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:50:28.464914 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-153c8b28-c851-4fda-ae82-477431da2e47 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:28.465720 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-153c8b28-c851-4fda-ae82-477431da2e47 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:28.475411 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-153c8b28-c851-4fda-ae82-477431da2e47 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:28.476549 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-153c8b28-c851-4fda-ae82-477431da2e47 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:28.477685 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-153c8b28-c851-4fda-ae82-477431da2e47 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:28.478413 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-153c8b28-c851-4fda-ae82-477431da2e47 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:28.740113 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-63a64d8c-7a4d-40df-8159-9352e8db2a4e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:28.755090 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-63a64d8c-7a4d-40df-8159-9352e8db2a4e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1279 microversion: 2.1 time: 0.528423 Jul 18 10:50:28.756270 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 183/370] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:28 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1279 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:28.897490 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-153c8b28-c851-4fda-ae82-477431da2e47 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:28.910663 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-153c8b28-c851-4fda-ae82-477431da2e47 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:28.913024 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-153c8b28-c851-4fda-ae82-477431da2e47 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:28.915581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-153c8b28-c851-4fda-ae82-477431da2e47 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1750 microversion: 2.20 time: 0.455955 Jul 18 10:50:28.929845 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 188/371] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:28 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1750 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:50:29.776899 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-75de9a81-db5b-47d9-9d82-af5fe2b9230c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:29.777673 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-75de9a81-db5b-47d9-9d82-af5fe2b9230c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:29.784913 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-75de9a81-db5b-47d9-9d82-af5fe2b9230c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:29.785870 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-75de9a81-db5b-47d9-9d82-af5fe2b9230c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:29.786841 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-75de9a81-db5b-47d9-9d82-af5fe2b9230c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:29.787480 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-75de9a81-db5b-47d9-9d82-af5fe2b9230c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:29.934330 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-9689e580-e151-4ecd-9e85-1b375c7c2b88 req-972b3d5f-73ab-4bc6-8159-1419d0b1b0cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "309e30be-b4c2-4959-97f8-1ea7925c9e5c", "tag": "d0664086-9234-4f4b-a1d4-a34f998954fe"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:29.977368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-9689e580-e151-4ecd-9e85-1b375c7c2b88 req-972b3d5f-73ab-4bc6-8159-1419d0b1b0cb service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:29.981525 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-9689e580-e151-4ecd-9e85-1b375c7c2b88 req-972b3d5f-73ab-4bc6-8159-1419d0b1b0cb service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:30.006383 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-9689e580-e151-4ecd-9e85-1b375c7c2b88 req-972b3d5f-73ab-4bc6-8159-1419d0b1b0cb service nova] Creating event network-changed:d0664086-9234-4f4b-a1d4-a34f998954fe for instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c on hv-cinder-84949 Jul 18 10:50:30.017410 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-9689e580-e151-4ecd-9e85-1b375c7c2b88 req-972b3d5f-73ab-4bc6-8159-1419d0b1b0cb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091782 Jul 18 10:50:30.018339 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 189/372] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:30.027282 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-474a8a90-c985-4b39-b06f-485606f03b02 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:30.028000 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-474a8a90-c985-4b39-b06f-485606f03b02 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:30.061418 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-474a8a90-c985-4b39-b06f-485606f03b02 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:30.062221 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-474a8a90-c985-4b39-b06f-485606f03b02 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:30.063200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-474a8a90-c985-4b39-b06f-485606f03b02 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:30.063859 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-474a8a90-c985-4b39-b06f-485606f03b02 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:30.145592 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-75de9a81-db5b-47d9-9d82-af5fe2b9230c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:30.172206 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-75de9a81-db5b-47d9-9d82-af5fe2b9230c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.399677 Jul 18 10:50:30.173657 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 184/373] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:29 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:30.415932 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-474a8a90-c985-4b39-b06f-485606f03b02 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:30.437611 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-474a8a90-c985-4b39-b06f-485606f03b02 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:30.439679 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-474a8a90-c985-4b39-b06f-485606f03b02 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:30.441028 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-474a8a90-c985-4b39-b06f-485606f03b02 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1750 microversion: 2.20 time: 0.421414 Jul 18 10:50:30.442101 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 190/374] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:30 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1750 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:30.650609 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e52f3e18-c716-4da1-be13-8d40d60a758b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:30.658058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e52f3e18-c716-4da1-be13-8d40d60a758b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:30.658760 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e52f3e18-c716-4da1-be13-8d40d60a758b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:30.736928 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e52f3e18-c716-4da1-be13-8d40d60a758b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Going to try to stop instance {{(pid=125005) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 10:50:31.149114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e52f3e18-c716-4da1-be13-8d40d60a758b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "POST /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/action" status: 202 len: 0 microversion: 2.1 time: 0.502588 Jul 18 10:50:31.149963 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 185/375] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 18 10:50:30 2022] POST /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:50:31.158298 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f07bcc48-807d-457c-888e-e5d042f05a8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:31.167001 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f07bcc48-807d-457c-888e-e5d042f05a8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:31.167001 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f07bcc48-807d-457c-888e-e5d042f05a8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:31.167519 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f07bcc48-807d-457c-888e-e5d042f05a8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:31.168314 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f07bcc48-807d-457c-888e-e5d042f05a8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:31.168882 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f07bcc48-807d-457c-888e-e5d042f05a8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:31.197008 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-48ca2f81-609d-4e5c-8156-aadc6653850c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:31.197953 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-48ca2f81-609d-4e5c-8156-aadc6653850c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:31.206144 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-48ca2f81-609d-4e5c-8156-aadc6653850c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:31.212876 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-48ca2f81-609d-4e5c-8156-aadc6653850c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:31.212876 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-48ca2f81-609d-4e5c-8156-aadc6653850c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:31.212876 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-48ca2f81-609d-4e5c-8156-aadc6653850c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:31.557069 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f07bcc48-807d-457c-888e-e5d042f05a8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:31.565289 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-48ca2f81-609d-4e5c-8156-aadc6653850c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:31.567191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f07bcc48-807d-457c-888e-e5d042f05a8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1678 microversion: 2.1 time: 0.412860 Jul 18 10:50:31.568424 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 191/376] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:31 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1678 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:31.573654 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e58a9733-2cfe-4205-a4bd-44d3a9e0fa92 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:31.574252 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-e58a9733-2cfe-4205-a4bd-44d3a9e0fa92 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:31.582015 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e58a9733-2cfe-4205-a4bd-44d3a9e0fa92 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:31.582731 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e58a9733-2cfe-4205-a4bd-44d3a9e0fa92 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:31.583397 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-48ca2f81-609d-4e5c-8156-aadc6653850c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.393632 Jul 18 10:50:31.583884 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e58a9733-2cfe-4205-a4bd-44d3a9e0fa92 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:31.584494 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 186/377] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:31 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:31.584732 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e58a9733-2cfe-4205-a4bd-44d3a9e0fa92 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:31.762165 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e58a9733-2cfe-4205-a4bd-44d3a9e0fa92 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:31.788143 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e58a9733-2cfe-4205-a4bd-44d3a9e0fa92 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:31.795816 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e58a9733-2cfe-4205-a4bd-44d3a9e0fa92 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:31.800800 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e58a9733-2cfe-4205-a4bd-44d3a9e0fa92 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1750 microversion: 2.20 time: 0.227793 Jul 18 10:50:31.802073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 192/378] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:31 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1750 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:32.587108 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bcd4f7a5-25a7-4787-bb1d-8291ad61649e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:32.588172 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-bcd4f7a5-25a7-4787-bb1d-8291ad61649e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:32.599894 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bcd4f7a5-25a7-4787-bb1d-8291ad61649e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:32.599894 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bcd4f7a5-25a7-4787-bb1d-8291ad61649e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:32.599894 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bcd4f7a5-25a7-4787-bb1d-8291ad61649e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:32.601111 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bcd4f7a5-25a7-4787-bb1d-8291ad61649e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:32.613013 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-66fc9fcb-935d-428b-98d6-dedd931e7837 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:32.613799 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-66fc9fcb-935d-428b-98d6-dedd931e7837 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:32.623213 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-66fc9fcb-935d-428b-98d6-dedd931e7837 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:32.626653 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-66fc9fcb-935d-428b-98d6-dedd931e7837 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:32.626653 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-66fc9fcb-935d-428b-98d6-dedd931e7837 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:32.626653 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-66fc9fcb-935d-428b-98d6-dedd931e7837 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:32.817856 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=2 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:32.842440 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=6 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:32.876125 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bcd4f7a5-25a7-4787-bb1d-8291ad61649e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:32.886970 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-bcd4f7a5-25a7-4787-bb1d-8291ad61649e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1678 microversion: 2.1 time: 0.305010 Jul 18 10:50:32.887730 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 187/379] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:32 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1678 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:32.893671 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9bd90c05-68df-4e01-b134-fe388b89beef tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:32.894644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-9bd90c05-68df-4e01-b134-fe388b89beef tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:32.903140 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9bd90c05-68df-4e01-b134-fe388b89beef tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:32.904627 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9bd90c05-68df-4e01-b134-fe388b89beef tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:32.905670 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9bd90c05-68df-4e01-b134-fe388b89beef tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:32.906402 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9bd90c05-68df-4e01-b134-fe388b89beef tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:32.916334 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-66fc9fcb-935d-428b-98d6-dedd931e7837 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:32.924947 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-66fc9fcb-935d-428b-98d6-dedd931e7837 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.316090 Jul 18 10:50:32.925670 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 193/380] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:32 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:33.065852 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9bd90c05-68df-4e01-b134-fe388b89beef tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:33.079847 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9bd90c05-68df-4e01-b134-fe388b89beef tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:33.081291 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9bd90c05-68df-4e01-b134-fe388b89beef tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:33.082474 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9bd90c05-68df-4e01-b134-fe388b89beef tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1750 microversion: 2.20 time: 0.193680 Jul 18 10:50:33.083373 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 188/381] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:32 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1750 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:33.909196 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3cdda9ba-6d67-46e2-ae95-1b8e5a5d2176 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:33.909802 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3cdda9ba-6d67-46e2-ae95-1b8e5a5d2176 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:33.917155 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3cdda9ba-6d67-46e2-ae95-1b8e5a5d2176 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:33.931277 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3cdda9ba-6d67-46e2-ae95-1b8e5a5d2176 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:33.931277 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3cdda9ba-6d67-46e2-ae95-1b8e5a5d2176 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:33.931277 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3cdda9ba-6d67-46e2-ae95-1b8e5a5d2176 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:33.937276 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:33.945663 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-02feac08-b3ac-4488-9beb-4f756ab582d9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:33.946526 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-02feac08-b3ac-4488-9beb-4f756ab582d9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:33.952908 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-02feac08-b3ac-4488-9beb-4f756ab582d9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:33.953375 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-02feac08-b3ac-4488-9beb-4f756ab582d9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:33.954226 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-02feac08-b3ac-4488-9beb-4f756ab582d9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:33.954654 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-02feac08-b3ac-4488-9beb-4f756ab582d9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:34.178323 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3cdda9ba-6d67-46e2-ae95-1b8e5a5d2176 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:34.186247 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3cdda9ba-6d67-46e2-ae95-1b8e5a5d2176 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1678 microversion: 2.1 time: 0.280947 Jul 18 10:50:34.196488 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 194/382] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:33 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1678 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:34.196488 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2ed6d8e8-7af5-4c0b-a0f2-6956efcb18cb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:34.196488 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2ed6d8e8-7af5-4c0b-a0f2-6956efcb18cb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:34.199707 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ed6d8e8-7af5-4c0b-a0f2-6956efcb18cb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:34.200157 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ed6d8e8-7af5-4c0b-a0f2-6956efcb18cb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:34.201493 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ed6d8e8-7af5-4c0b-a0f2-6956efcb18cb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:34.201928 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ed6d8e8-7af5-4c0b-a0f2-6956efcb18cb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:34.210146 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-02feac08-b3ac-4488-9beb-4f756ab582d9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:34.219759 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-02feac08-b3ac-4488-9beb-4f756ab582d9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.277623 Jul 18 10:50:34.220331 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 189/383] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:33 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:34.353533 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2ed6d8e8-7af5-4c0b-a0f2-6956efcb18cb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:34.362296 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2ed6d8e8-7af5-4c0b-a0f2-6956efcb18cb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:34.363794 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2ed6d8e8-7af5-4c0b-a0f2-6956efcb18cb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:34.364994 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2ed6d8e8-7af5-4c0b-a0f2-6956efcb18cb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1752 microversion: 2.20 time: 0.176753 Jul 18 10:50:34.365589 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 195/384] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:34 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:35.204205 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-756ddce9-3b81-49e2-8345-3f66d48b20a2 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:35.204916 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-756ddce9-3b81-49e2-8345-3f66d48b20a2 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:35.211702 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-756ddce9-3b81-49e2-8345-3f66d48b20a2 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.225104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-756ddce9-3b81-49e2-8345-3f66d48b20a2 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.225104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-756ddce9-3b81-49e2-8345-3f66d48b20a2 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.225104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-756ddce9-3b81-49e2-8345-3f66d48b20a2 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.225104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:35.237315 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=8 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:35.244258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f0ee2791-bc65-4f8e-ba12-92784cec8204 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:35.244992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f0ee2791-bc65-4f8e-ba12-92784cec8204 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:35.263235 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f0ee2791-bc65-4f8e-ba12-92784cec8204 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.263235 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f0ee2791-bc65-4f8e-ba12-92784cec8204 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.263235 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f0ee2791-bc65-4f8e-ba12-92784cec8204 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.263235 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f0ee2791-bc65-4f8e-ba12-92784cec8204 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.484212 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-756ddce9-3b81-49e2-8345-3f66d48b20a2 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:35.489944 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f0ee2791-bc65-4f8e-ba12-92784cec8204 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:35.493029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-756ddce9-3b81-49e2-8345-3f66d48b20a2 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1678 microversion: 2.1 time: 0.292949 Jul 18 10:50:35.493637 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 190/385] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:35 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1678 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:35.498922 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d2cd0c0c-c06d-4dc1-9f55-56639ce90e55 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:35.499262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f0ee2791-bc65-4f8e-ba12-92784cec8204 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.263952 Jul 18 10:50:35.499532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d2cd0c0c-c06d-4dc1-9f55-56639ce90e55 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:35.500078 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 196/386] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:35 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:35.506433 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d2cd0c0c-c06d-4dc1-9f55-56639ce90e55 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.507523 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d2cd0c0c-c06d-4dc1-9f55-56639ce90e55 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.508074 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d2cd0c0c-c06d-4dc1-9f55-56639ce90e55 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.509414 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d2cd0c0c-c06d-4dc1-9f55-56639ce90e55 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.669526 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-d2cd0c0c-c06d-4dc1-9f55-56639ce90e55 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:35.679459 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-d2cd0c0c-c06d-4dc1-9f55-56639ce90e55 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:35.681360 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-d2cd0c0c-c06d-4dc1-9f55-56639ce90e55 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:35.682576 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d2cd0c0c-c06d-4dc1-9f55-56639ce90e55 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1752 microversion: 2.20 time: 0.188009 Jul 18 10:50:35.683129 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 191/387] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:35 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:36.516165 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-60d72cde-5a69-4fc7-9b85-6244f93c3f70 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:36.524145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-60d72cde-5a69-4fc7-9b85-6244f93c3f70 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:36.524321 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b4b41319-c1f1-48a3-8ffd-dc61484dbee5 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:36.524321 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b4b41319-c1f1-48a3-8ffd-dc61484dbee5 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:36.525338 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-60d72cde-5a69-4fc7-9b85-6244f93c3f70 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:36.525973 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-60d72cde-5a69-4fc7-9b85-6244f93c3f70 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:36.526949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-60d72cde-5a69-4fc7-9b85-6244f93c3f70 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:36.527686 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-60d72cde-5a69-4fc7-9b85-6244f93c3f70 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:36.530754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b4b41319-c1f1-48a3-8ffd-dc61484dbee5 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:36.531352 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b4b41319-c1f1-48a3-8ffd-dc61484dbee5 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:36.532519 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b4b41319-c1f1-48a3-8ffd-dc61484dbee5 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:36.533096 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b4b41319-c1f1-48a3-8ffd-dc61484dbee5 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:36.869482 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-b4b41319-c1f1-48a3-8ffd-dc61484dbee5 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:36.882199 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-60d72cde-5a69-4fc7-9b85-6244f93c3f70 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:36.883827 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b4b41319-c1f1-48a3-8ffd-dc61484dbee5 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.366637 Jul 18 10:50:36.885016 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 192/388] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:36 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:36.892182 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7bf8a40b-6e1d-461a-af13-ee4238314041 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:36.893019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-7bf8a40b-6e1d-461a-af13-ee4238314041 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:36.898983 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-60d72cde-5a69-4fc7-9b85-6244f93c3f70 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1678 microversion: 2.1 time: 0.389034 Jul 18 10:50:36.903526 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 197/389] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:36 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1678 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:36.903786 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7bf8a40b-6e1d-461a-af13-ee4238314041 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:36.903786 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7bf8a40b-6e1d-461a-af13-ee4238314041 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:36.903786 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7bf8a40b-6e1d-461a-af13-ee4238314041 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:36.903786 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7bf8a40b-6e1d-461a-af13-ee4238314041 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:37.069738 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7bf8a40b-6e1d-461a-af13-ee4238314041 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:37.079123 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7bf8a40b-6e1d-461a-af13-ee4238314041 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:37.080638 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7bf8a40b-6e1d-461a-af13-ee4238314041 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:37.082077 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7bf8a40b-6e1d-461a-af13-ee4238314041 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.195850 Jul 18 10:50:37.083993 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 193/390] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:36 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:37.902053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-37e8d772-6f43-446d-8050-2efee2cd359b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:37.902679 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-37e8d772-6f43-446d-8050-2efee2cd359b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:37.910761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-37e8d772-6f43-446d-8050-2efee2cd359b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:37.911123 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-37e8d772-6f43-446d-8050-2efee2cd359b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:37.911943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-37e8d772-6f43-446d-8050-2efee2cd359b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:37.912549 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-37e8d772-6f43-446d-8050-2efee2cd359b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:37.925200 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8e7804ad-4cce-4dc9-a890-c60774523c8f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:37.926754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8e7804ad-4cce-4dc9-a890-c60774523c8f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:37.939032 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8e7804ad-4cce-4dc9-a890-c60774523c8f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:37.939985 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8e7804ad-4cce-4dc9-a890-c60774523c8f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:37.941575 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8e7804ad-4cce-4dc9-a890-c60774523c8f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:37.942506 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8e7804ad-4cce-4dc9-a890-c60774523c8f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:38.149580 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-37e8d772-6f43-446d-8050-2efee2cd359b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:38.157710 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-37e8d772-6f43-446d-8050-2efee2cd359b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.259804 Jul 18 10:50:38.158565 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 198/391] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:37 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:38.165433 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-1295ed46-1c93-4410-9168-934ef03a85e4 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:38.166230 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-1295ed46-1c93-4410-9168-934ef03a85e4 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:38.173626 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1295ed46-1c93-4410-9168-934ef03a85e4 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:38.174074 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1295ed46-1c93-4410-9168-934ef03a85e4 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:38.174845 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1295ed46-1c93-4410-9168-934ef03a85e4 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:38.175271 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1295ed46-1c93-4410-9168-934ef03a85e4 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:38.176316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8e7804ad-4cce-4dc9-a890-c60774523c8f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:38.186428 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8e7804ad-4cce-4dc9-a890-c60774523c8f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1678 microversion: 2.1 time: 0.269505 Jul 18 10:50:38.187394 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 194/392] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:37 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1678 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:38.342970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-1295ed46-1c93-4410-9168-934ef03a85e4 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:38.353895 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-1295ed46-1c93-4410-9168-934ef03a85e4 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:38.355529 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-1295ed46-1c93-4410-9168-934ef03a85e4 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:38.356989 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-1295ed46-1c93-4410-9168-934ef03a85e4 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.197157 Jul 18 10:50:38.357637 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 199/393] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:38 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:39.176390 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-4ffd5aab-5990-4dd2-a839-8b3addb8e168 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:39.177417 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-4ffd5aab-5990-4dd2-a839-8b3addb8e168 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:39.184136 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4ffd5aab-5990-4dd2-a839-8b3addb8e168 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:39.185320 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4ffd5aab-5990-4dd2-a839-8b3addb8e168 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:39.186136 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4ffd5aab-5990-4dd2-a839-8b3addb8e168 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:39.186542 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4ffd5aab-5990-4dd2-a839-8b3addb8e168 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:39.206168 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5cd87528-749a-4cd4-8eed-61c56b61a834 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:39.207365 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-5cd87528-749a-4cd4-8eed-61c56b61a834 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:39.214612 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5cd87528-749a-4cd4-8eed-61c56b61a834 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:39.215541 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5cd87528-749a-4cd4-8eed-61c56b61a834 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:39.217369 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5cd87528-749a-4cd4-8eed-61c56b61a834 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:39.218128 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5cd87528-749a-4cd4-8eed-61c56b61a834 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:39.444282 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4ffd5aab-5990-4dd2-a839-8b3addb8e168 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:39.452386 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-4ffd5aab-5990-4dd2-a839-8b3addb8e168 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.280041 Jul 18 10:50:39.453000 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 195/394] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:39 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:39.461004 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-5cd87528-749a-4cd4-8eed-61c56b61a834 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:39.462390 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-22d12774-a61a-466e-8def-3ebd9eeb4adb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:39.463128 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-22d12774-a61a-466e-8def-3ebd9eeb4adb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:39.472988 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5cd87528-749a-4cd4-8eed-61c56b61a834 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1678 microversion: 2.1 time: 0.270771 Jul 18 10:50:39.474043 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 200/395] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:39 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1678 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:39.482264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-22d12774-a61a-466e-8def-3ebd9eeb4adb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:39.482983 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-22d12774-a61a-466e-8def-3ebd9eeb4adb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:39.484347 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-22d12774-a61a-466e-8def-3ebd9eeb4adb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:39.485990 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-22d12774-a61a-466e-8def-3ebd9eeb4adb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:39.667364 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-22d12774-a61a-466e-8def-3ebd9eeb4adb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:39.682545 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-22d12774-a61a-466e-8def-3ebd9eeb4adb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:39.686897 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-22d12774-a61a-466e-8def-3ebd9eeb4adb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:39.688587 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-22d12774-a61a-466e-8def-3ebd9eeb4adb tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.234648 Jul 18 10:50:39.689699 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 196/396] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:39 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:40.470067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-90aaadf9-80d6-472b-98f4-98f71561ccf3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:40.470680 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-90aaadf9-80d6-472b-98f4-98f71561ccf3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:40.477942 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-90aaadf9-80d6-472b-98f4-98f71561ccf3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:40.479873 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-90aaadf9-80d6-472b-98f4-98f71561ccf3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:40.479873 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-90aaadf9-80d6-472b-98f4-98f71561ccf3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:40.479873 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-90aaadf9-80d6-472b-98f4-98f71561ccf3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:40.492898 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-96834e23-a53b-4392-bb93-71054741d339 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:40.494276 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-96834e23-a53b-4392-bb93-71054741d339 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:40.502312 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-96834e23-a53b-4392-bb93-71054741d339 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:40.503098 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-96834e23-a53b-4392-bb93-71054741d339 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:40.504156 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-96834e23-a53b-4392-bb93-71054741d339 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:40.504901 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-96834e23-a53b-4392-bb93-71054741d339 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:40.714845 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-96834e23-a53b-4392-bb93-71054741d339 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:40.742621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-90aaadf9-80d6-472b-98f4-98f71561ccf3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:40.749743 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-90aaadf9-80d6-472b-98f4-98f71561ccf3 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.283661 Jul 18 10:50:40.750073 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-96834e23-a53b-4392-bb93-71054741d339 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1678 microversion: 2.1 time: 0.255666 Jul 18 10:50:40.750810 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 197/397] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:40 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1678 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:40.752640 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 201/398] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:40 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:40.756468 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-cffc19f8-8a91-450e-b577-3ef7471c6be9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:40.756992 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-cffc19f8-8a91-450e-b577-3ef7471c6be9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:40.774188 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cffc19f8-8a91-450e-b577-3ef7471c6be9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:40.774713 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cffc19f8-8a91-450e-b577-3ef7471c6be9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:40.775580 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cffc19f8-8a91-450e-b577-3ef7471c6be9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:40.776093 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cffc19f8-8a91-450e-b577-3ef7471c6be9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:40.985060 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-cffc19f8-8a91-450e-b577-3ef7471c6be9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:40.995949 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-cffc19f8-8a91-450e-b577-3ef7471c6be9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:40.997974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-cffc19f8-8a91-450e-b577-3ef7471c6be9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:40.999382 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-cffc19f8-8a91-450e-b577-3ef7471c6be9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.247484 Jul 18 10:50:41.000088 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 198/399] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:40 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:41.292908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-750597307", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1160011770", "security_groups": [{"name": "tempest-secgroup-smoke-1615706679"}], "networks": [{"uuid": "eb380554-1a32-48db-8ee9-21d41ce83dd0"}], "block_device_mapping_v2": [{"uuid": "90a4ee52-be4b-4e8a-9f3a-94933edc20be", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:41.421174 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.network.neutron [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] validate_networks() for [('eb380554-1a32-48db-8ee9-21d41ce83dd0', None, None, None, None, None)] {{(pid=125007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:50:41.483370 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e5855b72-feee-4ffd-8958-0b13fbd72237 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a19cf8de-afb4-48ee-a3df-ec5e8c0cb8e6"}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:41.486706 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e5855b72-feee-4ffd-8958-0b13fbd72237 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:41.498208 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e5855b72-feee-4ffd-8958-0b13fbd72237 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:41.500069 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e5855b72-feee-4ffd-8958-0b13fbd72237 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:41.514108 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e5855b72-feee-4ffd-8958-0b13fbd72237 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:41.514108 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e5855b72-feee-4ffd-8958-0b13fbd72237 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:42.015120 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Flavor limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:50:42.015667 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Image limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:50:42.016130 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Flavor pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:50:42.016561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Image pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:50:42.017039 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:50:42.027195 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:42.027672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:42.028706 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:42.029518 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:42.052270 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Getting quotas for project 7f36b12884cc423988d28fdcbdb1d8f9. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:50:42.058049 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Getting quotas for user 926d4c4971f1425b98aa5828f802fb21 and project 7f36b12884cc423988d28fdcbdb1d8f9. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:50:42.147294 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Going to run 1 instances... {{(pid=125007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:50:42.151996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='90a4ee52-be4b-4e8a-9f3a-94933edc20be',volume_size=None,volume_type=None)] {{(pid=125007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:50:43.342821 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-39a2f4c0-a2f0-401a-b10f-e07cc911ad1d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.052305 Jul 18 10:50:43.349970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 202/400] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:50:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:50:43.363883 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b5b681d8-e2ac-4ff1-a9fd-65205b389a65 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:43.366801 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b5b681d8-e2ac-4ff1-a9fd-65205b389a65 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:43.375087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b5b681d8-e2ac-4ff1-a9fd-65205b389a65 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:43.375546 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b5b681d8-e2ac-4ff1-a9fd-65205b389a65 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:43.376488 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b5b681d8-e2ac-4ff1-a9fd-65205b389a65 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:43.376966 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b5b681d8-e2ac-4ff1-a9fd-65205b389a65 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:43.577689 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b5b681d8-e2ac-4ff1-a9fd-65205b389a65 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:43.586821 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b5b681d8-e2ac-4ff1-a9fd-65205b389a65 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1678 microversion: 2.1 time: 0.235380 Jul 18 10:50:43.587949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 203/401] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:43 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:43.609977 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-81592f71-fadc-4993-82b4-44bee2ddd9fc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:43.609977 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-81592f71-fadc-4993-82b4-44bee2ddd9fc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:43.609977 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-81592f71-fadc-4993-82b4-44bee2ddd9fc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:43.609977 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-81592f71-fadc-4993-82b4-44bee2ddd9fc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:43.610656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-81592f71-fadc-4993-82b4-44bee2ddd9fc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:43.610656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-81592f71-fadc-4993-82b4-44bee2ddd9fc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:43.840377 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-81592f71-fadc-4993-82b4-44bee2ddd9fc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:43.854657 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-81592f71-fadc-4993-82b4-44bee2ddd9fc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.265373 Jul 18 10:50:43.855896 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 204/402] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:43 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:43.868311 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2f6f658d-2e6b-4348-8bbd-fd07a390466c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:43.876990 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2f6f658d-2e6b-4348-8bbd-fd07a390466c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:43.891260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2f6f658d-2e6b-4348-8bbd-fd07a390466c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:43.892306 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2f6f658d-2e6b-4348-8bbd-fd07a390466c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:43.893971 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2f6f658d-2e6b-4348-8bbd-fd07a390466c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:43.895273 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2f6f658d-2e6b-4348-8bbd-fd07a390466c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:44.145201 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2f6f658d-2e6b-4348-8bbd-fd07a390466c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:44.159827 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2f6f658d-2e6b-4348-8bbd-fd07a390466c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:44.161368 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2f6f658d-2e6b-4348-8bbd-fd07a390466c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:44.162560 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2f6f658d-2e6b-4348-8bbd-fd07a390466c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.304967 Jul 18 10:50:44.163125 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 205/403] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:43 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:44.168172 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-8e6fd9f8-e7ae-4818-8430-b7733e7745a7 req-ca142b9d-120a-4d67-8e9e-551770b5a6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309e30be-b4c2-4959-97f8-1ea7925c9e5c", "name": "network-vif-plugged", "status": "completed", "tag": "d0664086-9234-4f4b-a1d4-a34f998954fe"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:44.181812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-8e6fd9f8-e7ae-4818-8430-b7733e7745a7 req-ca142b9d-120a-4d67-8e9e-551770b5a6f3 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:44.182347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-8e6fd9f8-e7ae-4818-8430-b7733e7745a7 req-ca142b9d-120a-4d67-8e9e-551770b5a6f3 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:44.199761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-8e6fd9f8-e7ae-4818-8430-b7733e7745a7 req-ca142b9d-120a-4d67-8e9e-551770b5a6f3 service nova] Creating event network-vif-plugged:d0664086-9234-4f4b-a1d4-a34f998954fe for instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c on hv-cinder-84949 Jul 18 10:50:44.206882 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-8e6fd9f8-e7ae-4818-8430-b7733e7745a7 req-ca142b9d-120a-4d67-8e9e-551770b5a6f3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042005 Jul 18 10:50:44.208025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 206/404] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:44.220583 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-01ddd053-1296-4437-ae9e-80f303ef6443 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:44.221331 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-01ddd053-1296-4437-ae9e-80f303ef6443 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:44.230382 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-01ddd053-1296-4437-ae9e-80f303ef6443 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:44.231683 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-01ddd053-1296-4437-ae9e-80f303ef6443 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:44.232624 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-01ddd053-1296-4437-ae9e-80f303ef6443 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:44.233204 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-01ddd053-1296-4437-ae9e-80f303ef6443 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:44.265517 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-01ddd053-1296-4437-ae9e-80f303ef6443 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1/ips" status: 200 len: 148 microversion: 2.1 time: 0.056052 Jul 18 10:50:44.266232 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 207/405] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 18 10:50:44 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1/ips => generated 148 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:44.271144 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-bff089be-0882-4ffe-9d68-3deb2d6b63b1 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:44.271757 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-bff089be-0882-4ffe-9d68-3deb2d6b63b1 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:44.337611 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-bff089be-0882-4ffe-9d68-3deb2d6b63b1 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:44.347773 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-bff089be-0882-4ffe-9d68-3deb2d6b63b1 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1088 microversion: 2.1 time: 0.080381 Jul 18 10:50:44.350302 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 208/406] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:44 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1088 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:44.356336 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ab1175e5-702f-4c94-8a33-83b13db1c9de tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e80ea525-8bda-45d2-90e7-a5f905bbfed1"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:44.357892 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ab1175e5-702f-4c94-8a33-83b13db1c9de tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:44.365381 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ab1175e5-702f-4c94-8a33-83b13db1c9de tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:44.371416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ab1175e5-702f-4c94-8a33-83b13db1c9de tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:44.371416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ab1175e5-702f-4c94-8a33-83b13db1c9de tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:44.371416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ab1175e5-702f-4c94-8a33-83b13db1c9de tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:44.470256 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-ab1175e5-702f-4c94-8a33-83b13db1c9de tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] HTTP exception thrown: Invalid volume: volume e80ea525-8bda-45d2-90e7-a5f905bbfed1 is already attached to instances: eadfa860-196c-4946-85a4-a9a2aed7c1b7 Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ab1175e5-702f-4c94-8a33-83b13db1c9de tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Request method failure captured: Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: POST /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1/os-volume_attachments HTTP/1.1 Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 74 Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To3grVh5eba67sMHj3Z1DSA3fIUC9f5wIxOuVBPUD51Z7C3u9-HXpsXd8cB6k0mN-6p1y9OtAmiFcgdD3J1fX4g3yITPuNgpxLVfMocjGOIBC9EjXhO_0oCAHoqkj4rFWVIlBvaa2J_jvIj5l1Y1IoF1YPGIt2tFFq5BZ3pTrErcdc Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:50:44.472147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:50:44.474147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:50:44.474147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:50:44.474147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:50:44.474147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:50:44.474147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:50:44.474147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:50:44.474147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:50:44.474147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 3954fd4abf6b4c3a82280c762292a3e7 Jul 18 10:50:44.474147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:50:44.474147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Jul 18 10:50:44.474147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {"volumeAttachment": {"volumeId": "e80ea525-8bda-45d2-90e7-a5f905bbfed1"}} Jul 18 10:50:44.474147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Invalid volume: volume e80ea525-8bda-45d2-90e7-a5f905bbfed1 is already attached to instances: eadfa860-196c-4946-85a4-a9a2aed7c1b7 Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'server_id': '31366990-97f1-495a-98b8-0ff44a44f7e1', 'body': {'volumeAttachment': {'volumeId': 'e80ea525-8bda-45d2-90e7-a5f905bbfed1'}}} Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e80ea525-8bda-45d2-90e7-a5f905bbfed1 is already attached to instances: eadfa860-196c-4946-85a4-a9a2aed7c1b7 Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:50:44.475261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e80ea525-8bda-45d2-90e7-a5f905bbfed1 is already attached to instances: eadfa860-196c-4946-85a4-a9a2aed7c1b7 Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:44.476761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:44.477954 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:44.477954 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:44.477954 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:44.477954 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e80ea525-8bda-45d2-90e7-a5f905bbfed1 is already attached to instances: eadfa860-196c-4946-85a4-a9a2aed7c1b7 Jul 18 10:50:44.477954 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:50:44.477954 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ab1175e5-702f-4c94-8a33-83b13db1c9de tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Returning 400 to user: Invalid volume: volume e80ea525-8bda-45d2-90e7-a5f905bbfed1 is already attached to instances: eadfa860-196c-4946-85a4-a9a2aed7c1b7 {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:44.477954 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ab1175e5-702f-4c94-8a33-83b13db1c9de tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "POST /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122459 Jul 18 10:50:44.477954 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 209/407] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 18 10:50:44 2022] POST /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:50:44.485199 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-87955b48-69b1-4730-8a52-62a01aab970f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:44.485749 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-87955b48-69b1-4730-8a52-62a01aab970f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:44.488189 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:44.498559 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87955b48-69b1-4730-8a52-62a01aab970f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:44.499040 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87955b48-69b1-4730-8a52-62a01aab970f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:44.499893 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87955b48-69b1-4730-8a52-62a01aab970f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:44.500485 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87955b48-69b1-4730-8a52-62a01aab970f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:44.533534 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-87955b48-69b1-4730-8a52-62a01aab970f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Going to try to terminate instance {{(pid=125007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:50:45.032273 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-87955b48-69b1-4730-8a52-62a01aab970f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "DELETE /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 204 len: 0 microversion: 2.1 time: 0.552188 Jul 18 10:50:45.033045 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 210/408] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:50:44 2022] DELETE /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:50:45.037921 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3b206a66-ffc6-4409-9e14-320e4765018e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:45.041674 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3b206a66-ffc6-4409-9e14-320e4765018e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:45.045658 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3b206a66-ffc6-4409-9e14-320e4765018e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:45.046114 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3b206a66-ffc6-4409-9e14-320e4765018e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:45.046913 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3b206a66-ffc6-4409-9e14-320e4765018e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:45.047345 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3b206a66-ffc6-4409-9e14-320e4765018e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:45.224399 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3b206a66-ffc6-4409-9e14-320e4765018e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:45.234775 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3b206a66-ffc6-4409-9e14-320e4765018e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1678 microversion: 2.1 time: 0.200731 Jul 18 10:50:45.235339 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 211/409] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:45 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:45.240227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-13c9d5d7-d00f-4be8-895a-a8d8872274d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:45.240851 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-13c9d5d7-d00f-4be8-895a-a8d8872274d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:45.248442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-13c9d5d7-d00f-4be8-895a-a8d8872274d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:45.248925 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-13c9d5d7-d00f-4be8-895a-a8d8872274d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:45.249722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-13c9d5d7-d00f-4be8-895a-a8d8872274d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:45.250596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-13c9d5d7-d00f-4be8-895a-a8d8872274d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:45.253511 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:45.419553 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-13c9d5d7-d00f-4be8-895a-a8d8872274d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:45.424239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-13c9d5d7-d00f-4be8-895a-a8d8872274d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.187878 Jul 18 10:50:45.424835 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 212/410] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:45 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:45.429756 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-92fe32a8-99e5-451c-a1e5-d668e691f5a9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:45.430336 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-92fe32a8-99e5-451c-a1e5-d668e691f5a9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:45.437569 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-92fe32a8-99e5-451c-a1e5-d668e691f5a9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:45.438021 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-92fe32a8-99e5-451c-a1e5-d668e691f5a9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:45.439175 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-92fe32a8-99e5-451c-a1e5-d668e691f5a9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:45.439673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-92fe32a8-99e5-451c-a1e5-d668e691f5a9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:45.599436 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-92fe32a8-99e5-451c-a1e5-d668e691f5a9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:45.607983 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-92fe32a8-99e5-451c-a1e5-d668e691f5a9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1677 microversion: 2.1 time: 0.182084 Jul 18 10:50:45.608571 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 213/411] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:45 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:45.614239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6246a463-5a8d-49bf-894b-a64427604294 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:45.614952 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6246a463-5a8d-49bf-894b-a64427604294 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:45.623276 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6246a463-5a8d-49bf-894b-a64427604294 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:45.623754 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6246a463-5a8d-49bf-894b-a64427604294 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:45.624546 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6246a463-5a8d-49bf-894b-a64427604294 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:45.625050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6246a463-5a8d-49bf-894b-a64427604294 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:45.791962 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-6246a463-5a8d-49bf-894b-a64427604294 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:45.801705 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-6246a463-5a8d-49bf-894b-a64427604294 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:45.803226 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-6246a463-5a8d-49bf-894b-a64427604294 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:45.804421 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6246a463-5a8d-49bf-894b-a64427604294 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.194885 Jul 18 10:50:45.805013 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 214/412] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:45 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:45.815953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-286e8a36-c3d7-4395-a437-7c1fe1c22fe2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:45.815953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-286e8a36-c3d7-4395-a437-7c1fe1c22fe2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:45.817053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-286e8a36-c3d7-4395-a437-7c1fe1c22fe2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:45.817053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-286e8a36-c3d7-4395-a437-7c1fe1c22fe2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:45.817844 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-286e8a36-c3d7-4395-a437-7c1fe1c22fe2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:45.818284 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-286e8a36-c3d7-4395-a437-7c1fe1c22fe2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:45.886282 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-286e8a36-c3d7-4395-a437-7c1fe1c22fe2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:45.895690 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-286e8a36-c3d7-4395-a437-7c1fe1c22fe2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1138 microversion: 2.1 time: 0.089622 Jul 18 10:50:45.896268 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 215/413] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:45 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1138 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:46.252281 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-42863d2d-2526-4036-b889-27acacc0a1ca tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:46.253035 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-42863d2d-2526-4036-b889-27acacc0a1ca tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:46.260279 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-42863d2d-2526-4036-b889-27acacc0a1ca tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:46.260847 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-42863d2d-2526-4036-b889-27acacc0a1ca tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:46.261635 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-42863d2d-2526-4036-b889-27acacc0a1ca tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:46.262073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-42863d2d-2526-4036-b889-27acacc0a1ca tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:46.419877 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-42863d2d-2526-4036-b889-27acacc0a1ca tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:46.429197 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-42863d2d-2526-4036-b889-27acacc0a1ca tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1678 microversion: 2.1 time: 0.180843 Jul 18 10:50:46.429817 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 216/414] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:46 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:46.443088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2ccef23c-82a0-435a-b653-a3398172afc7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:46.443727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2ccef23c-82a0-435a-b653-a3398172afc7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:46.450567 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ccef23c-82a0-435a-b653-a3398172afc7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:46.451019 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ccef23c-82a0-435a-b653-a3398172afc7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:46.451801 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ccef23c-82a0-435a-b653-a3398172afc7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:46.452230 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2ccef23c-82a0-435a-b653-a3398172afc7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:46.640587 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2ccef23c-82a0-435a-b653-a3398172afc7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:46.649103 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2ccef23c-82a0-435a-b653-a3398172afc7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.210453 Jul 18 10:50:46.649912 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 217/415] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:46 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:46.654692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2f6b3429-b15e-4476-b5d6-06499e1f5168 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:46.655295 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2f6b3429-b15e-4476-b5d6-06499e1f5168 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:46.661568 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2f6b3429-b15e-4476-b5d6-06499e1f5168 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:46.662024 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2f6b3429-b15e-4476-b5d6-06499e1f5168 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:46.662817 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2f6b3429-b15e-4476-b5d6-06499e1f5168 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:46.663260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2f6b3429-b15e-4476-b5d6-06499e1f5168 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:46.864968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2f6b3429-b15e-4476-b5d6-06499e1f5168 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:46.880423 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2f6b3429-b15e-4476-b5d6-06499e1f5168 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1677 microversion: 2.1 time: 0.229630 Jul 18 10:50:46.885001 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 218/416] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:46 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:46.886385 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b6448048-5540-4d4d-9718-423068089a73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:46.886983 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b6448048-5540-4d4d-9718-423068089a73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:46.896263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b6448048-5540-4d4d-9718-423068089a73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:46.896764 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b6448048-5540-4d4d-9718-423068089a73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:46.897984 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b6448048-5540-4d4d-9718-423068089a73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:46.898432 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b6448048-5540-4d4d-9718-423068089a73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:47.057518 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b6448048-5540-4d4d-9718-423068089a73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:47.068321 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b6448048-5540-4d4d-9718-423068089a73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:47.070115 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b6448048-5540-4d4d-9718-423068089a73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:47.073683 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b6448048-5540-4d4d-9718-423068089a73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.191120 Jul 18 10:50:47.074612 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 219/417] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:46 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:47.087246 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-292b028b-6e94-4369-955e-dd9092ac8606 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:47.090072 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-292b028b-6e94-4369-955e-dd9092ac8606 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:47.100510 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-292b028b-6e94-4369-955e-dd9092ac8606 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:47.101018 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-292b028b-6e94-4369-955e-dd9092ac8606 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:47.101932 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-292b028b-6e94-4369-955e-dd9092ac8606 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:47.102423 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-292b028b-6e94-4369-955e-dd9092ac8606 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:47.184012 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-292b028b-6e94-4369-955e-dd9092ac8606 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:47.192566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-292b028b-6e94-4369-955e-dd9092ac8606 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1138 microversion: 2.1 time: 0.115602 Jul 18 10:50:47.193260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 220/418] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:47 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1138 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:47.447635 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e8ac5bce-9738-4109-a31f-7c71afdaadf8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:47.448390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-e8ac5bce-9738-4109-a31f-7c71afdaadf8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:47.455241 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e8ac5bce-9738-4109-a31f-7c71afdaadf8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:47.455701 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e8ac5bce-9738-4109-a31f-7c71afdaadf8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:47.456443 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e8ac5bce-9738-4109-a31f-7c71afdaadf8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:47.456908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e8ac5bce-9738-4109-a31f-7c71afdaadf8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:47.602993 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e8ac5bce-9738-4109-a31f-7c71afdaadf8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:47.611748 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e8ac5bce-9738-4109-a31f-7c71afdaadf8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1678 microversion: 2.1 time: 0.168093 Jul 18 10:50:47.612914 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 221/419] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:47 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:47.669458 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-35980c27-2360-4b7a-82ee-2cd9d57f57b4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:47.670179 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-35980c27-2360-4b7a-82ee-2cd9d57f57b4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:47.676338 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-35980c27-2360-4b7a-82ee-2cd9d57f57b4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:47.679216 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-35980c27-2360-4b7a-82ee-2cd9d57f57b4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:47.679216 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-35980c27-2360-4b7a-82ee-2cd9d57f57b4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:47.679216 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-35980c27-2360-4b7a-82ee-2cd9d57f57b4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:47.819259 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-35980c27-2360-4b7a-82ee-2cd9d57f57b4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:47.827724 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-35980c27-2360-4b7a-82ee-2cd9d57f57b4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.162699 Jul 18 10:50:47.828310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 222/420] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:47 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:47.901117 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f60d54b8-f759-429a-a65c-0f512fde5956 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:47.902048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f60d54b8-f759-429a-a65c-0f512fde5956 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:47.908539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f60d54b8-f759-429a-a65c-0f512fde5956 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:47.909180 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f60d54b8-f759-429a-a65c-0f512fde5956 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:47.909961 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f60d54b8-f759-429a-a65c-0f512fde5956 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:47.910397 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f60d54b8-f759-429a-a65c-0f512fde5956 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:48.050205 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f60d54b8-f759-429a-a65c-0f512fde5956 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:48.058501 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f60d54b8-f759-429a-a65c-0f512fde5956 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1677 microversion: 2.1 time: 0.162732 Jul 18 10:50:48.058501 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 223/421] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:47 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:48.095683 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-561e7f9a-2e5d-4662-b710-79925eb894e3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:48.096414 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-561e7f9a-2e5d-4662-b710-79925eb894e3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:48.102708 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-561e7f9a-2e5d-4662-b710-79925eb894e3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:48.104291 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-561e7f9a-2e5d-4662-b710-79925eb894e3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:48.104291 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-561e7f9a-2e5d-4662-b710-79925eb894e3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:48.104759 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-561e7f9a-2e5d-4662-b710-79925eb894e3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:48.247500 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-561e7f9a-2e5d-4662-b710-79925eb894e3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:48.256315 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-561e7f9a-2e5d-4662-b710-79925eb894e3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:48.257842 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-561e7f9a-2e5d-4662-b710-79925eb894e3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:48.258981 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-561e7f9a-2e5d-4662-b710-79925eb894e3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.167565 Jul 18 10:50:48.259539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 224/422] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:48 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:50:48.264305 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3fd9c457-cd7b-49ee-8467-fd8d607a503a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:48.264930 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3fd9c457-cd7b-49ee-8467-fd8d607a503a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:48.273566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3fd9c457-cd7b-49ee-8467-fd8d607a503a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:48.274024 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3fd9c457-cd7b-49ee-8467-fd8d607a503a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:48.274797 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3fd9c457-cd7b-49ee-8467-fd8d607a503a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:48.275231 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3fd9c457-cd7b-49ee-8467-fd8d607a503a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:48.348266 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3fd9c457-cd7b-49ee-8467-fd8d607a503a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:48.355925 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3fd9c457-cd7b-49ee-8467-fd8d607a503a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1138 microversion: 2.1 time: 0.095425 Jul 18 10:50:48.357161 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 225/423] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:48 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1138 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:48.629668 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f41d65df-867b-421c-a38c-735d972cbbee tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:48.630303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f41d65df-867b-421c-a38c-735d972cbbee tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:48.636654 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f41d65df-867b-421c-a38c-735d972cbbee tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:48.637129 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f41d65df-867b-421c-a38c-735d972cbbee tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:48.638739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f41d65df-867b-421c-a38c-735d972cbbee tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:48.639236 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f41d65df-867b-421c-a38c-735d972cbbee tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:48.787777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f41d65df-867b-421c-a38c-735d972cbbee tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:48.795482 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f41d65df-867b-421c-a38c-735d972cbbee tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1655 microversion: 2.1 time: 0.169762 Jul 18 10:50:48.796050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 226/424] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:48 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1655 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:48.812559 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-731ade0b-937f-41c3-9f54-6972193c3fcd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:48.819372 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-731ade0b-937f-41c3-9f54-6972193c3fcd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:48.819806 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-731ade0b-937f-41c3-9f54-6972193c3fcd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:48.844196 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-731ade0b-937f-41c3-9f54-6972193c3fcd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Going to try to start instance {{(pid=125007) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 10:50:49.066381 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:49.256312 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-731ade0b-937f-41c3-9f54-6972193c3fcd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "POST /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/action" status: 202 len: 0 microversion: 2.1 time: 0.447754 Jul 18 10:50:49.256962 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 227/425] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 18 10:50:48 2022] POST /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 10:50:49.262918 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-75447929-856b-4e2e-9284-16382128059f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:49.263610 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-75447929-856b-4e2e-9284-16382128059f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:49.269930 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-75447929-856b-4e2e-9284-16382128059f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:49.270379 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-75447929-856b-4e2e-9284-16382128059f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:49.271171 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-75447929-856b-4e2e-9284-16382128059f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:49.271609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-75447929-856b-4e2e-9284-16382128059f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:49.409549 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-75447929-856b-4e2e-9284-16382128059f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:49.417379 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-75447929-856b-4e2e-9284-16382128059f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.159106 Jul 18 10:50:49.417941 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 228/426] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:49 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:49.423700 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-811e05cf-8863-4774-9e67-3e5fb24d76b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:49.424301 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-811e05cf-8863-4774-9e67-3e5fb24d76b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:49.430433 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-811e05cf-8863-4774-9e67-3e5fb24d76b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:49.430906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-811e05cf-8863-4774-9e67-3e5fb24d76b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:49.431634 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-811e05cf-8863-4774-9e67-3e5fb24d76b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:49.432064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-811e05cf-8863-4774-9e67-3e5fb24d76b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:49.573537 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-811e05cf-8863-4774-9e67-3e5fb24d76b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:49.582092 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-811e05cf-8863-4774-9e67-3e5fb24d76b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1677 microversion: 2.1 time: 0.162609 Jul 18 10:50:49.582674 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 229/427] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:49 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:49.587194 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e8a1e514-da40-4c68-895d-8966f57be749 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:49.587805 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-e8a1e514-da40-4c68-895d-8966f57be749 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:49.595636 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e8a1e514-da40-4c68-895d-8966f57be749 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:49.596086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e8a1e514-da40-4c68-895d-8966f57be749 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:49.596886 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e8a1e514-da40-4c68-895d-8966f57be749 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:49.597325 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e8a1e514-da40-4c68-895d-8966f57be749 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:49.743026 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e8a1e514-da40-4c68-895d-8966f57be749 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:49.751809 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e8a1e514-da40-4c68-895d-8966f57be749 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1664 microversion: 2.1 time: 0.168099 Jul 18 10:50:49.753080 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 230/428] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:49 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:49.766324 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-cf366729-b7ff-435d-ae77-1eedffd0b9c7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:49.766938 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-cf366729-b7ff-435d-ae77-1eedffd0b9c7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:49.773121 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cf366729-b7ff-435d-ae77-1eedffd0b9c7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:49.773573 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cf366729-b7ff-435d-ae77-1eedffd0b9c7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:49.774357 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cf366729-b7ff-435d-ae77-1eedffd0b9c7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:49.774837 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cf366729-b7ff-435d-ae77-1eedffd0b9c7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:49.944151 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-cf366729-b7ff-435d-ae77-1eedffd0b9c7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:49.954029 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-cf366729-b7ff-435d-ae77-1eedffd0b9c7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:49.955504 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-cf366729-b7ff-435d-ae77-1eedffd0b9c7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:49.956656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-cf366729-b7ff-435d-ae77-1eedffd0b9c7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.203233 Jul 18 10:50:49.957229 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 231/429] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:49 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:49.961785 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-c407851e-cef5-4da9-bf36-48381131fd31 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:49.962537 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-c407851e-cef5-4da9-bf36-48381131fd31 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:49.969613 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c407851e-cef5-4da9-bf36-48381131fd31 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:49.970224 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c407851e-cef5-4da9-bf36-48381131fd31 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:49.971038 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c407851e-cef5-4da9-bf36-48381131fd31 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:49.971736 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c407851e-cef5-4da9-bf36-48381131fd31 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:50.034160 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c407851e-cef5-4da9-bf36-48381131fd31 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:50.041914 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-c407851e-cef5-4da9-bf36-48381131fd31 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1138 microversion: 2.1 time: 0.083721 Jul 18 10:50:50.042477 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 232/430] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:49 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:50.445370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-00d9b8ae-b047-4db8-bbd0-1bc529c636f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:50.446703 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-00d9b8ae-b047-4db8-bbd0-1bc529c636f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:50.454142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-00d9b8ae-b047-4db8-bbd0-1bc529c636f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:50.460230 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-00d9b8ae-b047-4db8-bbd0-1bc529c636f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:50.461324 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-00d9b8ae-b047-4db8-bbd0-1bc529c636f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:50.461770 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-00d9b8ae-b047-4db8-bbd0-1bc529c636f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:50.723547 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-00d9b8ae-b047-4db8-bbd0-1bc529c636f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:50.731679 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-00d9b8ae-b047-4db8-bbd0-1bc529c636f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.301141 Jul 18 10:50:50.742093 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 233/431] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:50 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:50.742093 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5cde736a-41f3-4a22-bd5a-d86a2bd9b4a0 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:50.742093 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-5cde736a-41f3-4a22-bd5a-d86a2bd9b4a0 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:50.744498 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5cde736a-41f3-4a22-bd5a-d86a2bd9b4a0 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:50.745159 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5cde736a-41f3-4a22-bd5a-d86a2bd9b4a0 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:50.745739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5cde736a-41f3-4a22-bd5a-d86a2bd9b4a0 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:50.746196 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5cde736a-41f3-4a22-bd5a-d86a2bd9b4a0 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:50.841365 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e5855b72-feee-4ffd-8958-0b13fbd72237 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "POST /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.366808 Jul 18 10:50:50.842175 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 199/432] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 18 10:50:41 2022] POST /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments => generated 194 bytes in 9370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:50.847797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e2499f05-27ab-4d80-9a09-03bc335e106e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:50.848900 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e2499f05-27ab-4d80-9a09-03bc335e106e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:50.850899 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:50.857969 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e2499f05-27ab-4d80-9a09-03bc335e106e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:50.858640 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e2499f05-27ab-4d80-9a09-03bc335e106e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:50.859448 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e2499f05-27ab-4d80-9a09-03bc335e106e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:50.860057 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e2499f05-27ab-4d80-9a09-03bc335e106e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:51.390302 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-5cde736a-41f3-4a22-bd5a-d86a2bd9b4a0 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:51.398433 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5cde736a-41f3-4a22-bd5a-d86a2bd9b4a0 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1677 microversion: 2.1 time: 0.664813 Jul 18 10:50:51.399021 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 234/433] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:50 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1677 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:51.404025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ee8ae9e3-e6ce-4295-b45c-5e67f32329f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:51.404710 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ee8ae9e3-e6ce-4295-b45c-5e67f32329f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:51.411580 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ee8ae9e3-e6ce-4295-b45c-5e67f32329f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:51.412024 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ee8ae9e3-e6ce-4295-b45c-5e67f32329f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:51.412989 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ee8ae9e3-e6ce-4295-b45c-5e67f32329f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:51.413406 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ee8ae9e3-e6ce-4295-b45c-5e67f32329f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:51.432667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e2499f05-27ab-4d80-9a09-03bc335e106e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:51.440902 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e2499f05-27ab-4d80-9a09-03bc335e106e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1664 microversion: 2.1 time: 0.597359 Jul 18 10:50:51.441607 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 200/434] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:50 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1664 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:51.453871 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c932d8d7-ba89-49c5-ba84-9e887c480e60 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:51.454484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c932d8d7-ba89-49c5-ba84-9e887c480e60 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:51.460663 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c932d8d7-ba89-49c5-ba84-9e887c480e60 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:51.461148 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c932d8d7-ba89-49c5-ba84-9e887c480e60 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:51.461919 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c932d8d7-ba89-49c5-ba84-9e887c480e60 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:51.462357 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c932d8d7-ba89-49c5-ba84-9e887c480e60 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:51.552565 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c932d8d7-ba89-49c5-ba84-9e887c480e60 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:51.561798 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c932d8d7-ba89-49c5-ba84-9e887c480e60 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1186 microversion: 2.1 time: 0.118934 Jul 18 10:50:51.562569 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 201/435] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:51 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1186 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:51.662642 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ee8ae9e3-e6ce-4295-b45c-5e67f32329f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:51.671678 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ee8ae9e3-e6ce-4295-b45c-5e67f32329f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:51.680753 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ee8ae9e3-e6ce-4295-b45c-5e67f32329f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:51.680753 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ee8ae9e3-e6ce-4295-b45c-5e67f32329f8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.274474 Jul 18 10:50:51.680753 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 235/436] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:51 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:51.750381 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-52dd02cb-868c-4714-8bf2-8fa194cebca6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:51.751113 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-52dd02cb-868c-4714-8bf2-8fa194cebca6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:51.763731 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-52dd02cb-868c-4714-8bf2-8fa194cebca6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:51.764523 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-52dd02cb-868c-4714-8bf2-8fa194cebca6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:51.765816 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-52dd02cb-868c-4714-8bf2-8fa194cebca6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:51.766654 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-52dd02cb-868c-4714-8bf2-8fa194cebca6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:52.026479 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-52dd02cb-868c-4714-8bf2-8fa194cebca6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:52.035551 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-52dd02cb-868c-4714-8bf2-8fa194cebca6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1267 microversion: 2.1 time: 0.289420 Jul 18 10:50:52.036127 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 202/437] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:51 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1267 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:52.216066 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-b0769093-ad4e-406a-9a12-5e9c474fd184 req-e26740ef-9ef6-4024-914e-7f20562914de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31366990-97f1-495a-98b8-0ff44a44f7e1", "name": "network-vif-deleted", "tag": "d5f49a49-e03e-4d9f-b362-39d74c035041"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:52.220664 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=2 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:52.226649 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-b0769093-ad4e-406a-9a12-5e9c474fd184 req-e26740ef-9ef6-4024-914e-7f20562914de service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:52.239142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-b0769093-ad4e-406a-9a12-5e9c474fd184 req-e26740ef-9ef6-4024-914e-7f20562914de service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:52.239623 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-b0769093-ad4e-406a-9a12-5e9c474fd184 req-e26740ef-9ef6-4024-914e-7f20562914de service nova] Creating event network-vif-deleted:d5f49a49-e03e-4d9f-b362-39d74c035041 for instance 31366990-97f1-495a-98b8-0ff44a44f7e1 on hv-cinder-84949 Jul 18 10:50:52.244613 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-b0769093-ad4e-406a-9a12-5e9c474fd184 req-e26740ef-9ef6-4024-914e-7f20562914de service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032582 Jul 18 10:50:52.245434 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 236/438] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:52.422070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d7d276ac-f472-4535-91db-7fdc74121c5d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:52.426008 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d7d276ac-f472-4535-91db-7fdc74121c5d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:52.432736 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d7d276ac-f472-4535-91db-7fdc74121c5d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:52.433303 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d7d276ac-f472-4535-91db-7fdc74121c5d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:52.434968 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d7d276ac-f472-4535-91db-7fdc74121c5d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:52.435554 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d7d276ac-f472-4535-91db-7fdc74121c5d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:52.463244 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f69d682a-e885-43e2-9fd8-d5e25498fc0a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:52.463981 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f69d682a-e885-43e2-9fd8-d5e25498fc0a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:52.471787 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f69d682a-e885-43e2-9fd8-d5e25498fc0a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:52.472241 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f69d682a-e885-43e2-9fd8-d5e25498fc0a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:52.473615 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f69d682a-e885-43e2-9fd8-d5e25498fc0a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:52.474275 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f69d682a-e885-43e2-9fd8-d5e25498fc0a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:52.530283 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-d7d276ac-f472-4535-91db-7fdc74121c5d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:52.539174 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d7d276ac-f472-4535-91db-7fdc74121c5d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1612 microversion: 2.1 time: 0.126558 Jul 18 10:50:52.548916 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 203/439] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:52 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1612 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:52.581594 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-677b40bf-9d88-42ba-aa17-001fff50f8c2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:52.582787 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-677b40bf-9d88-42ba-aa17-001fff50f8c2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:52.590045 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-677b40bf-9d88-42ba-aa17-001fff50f8c2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:52.591661 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-677b40bf-9d88-42ba-aa17-001fff50f8c2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:52.592686 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-677b40bf-9d88-42ba-aa17-001fff50f8c2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:52.593315 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-677b40bf-9d88-42ba-aa17-001fff50f8c2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:52.647443 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f69d682a-e885-43e2-9fd8-d5e25498fc0a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:52.656570 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f69d682a-e885-43e2-9fd8-d5e25498fc0a tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1664 microversion: 2.1 time: 0.201360 Jul 18 10:50:52.657298 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 237/440] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:52 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1664 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:52.671668 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-677b40bf-9d88-42ba-aa17-001fff50f8c2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:52.680567 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-677b40bf-9d88-42ba-aa17-001fff50f8c2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1194 microversion: 2.1 time: 0.103503 Jul 18 10:50:52.681436 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 204/441] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:52 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1194 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:52.700341 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-06225bbe-2586-403e-8f3a-82cebf6b142b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:52.700341 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-06225bbe-2586-403e-8f3a-82cebf6b142b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:52.704095 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-06225bbe-2586-403e-8f3a-82cebf6b142b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:52.704736 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-06225bbe-2586-403e-8f3a-82cebf6b142b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:52.705720 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-06225bbe-2586-403e-8f3a-82cebf6b142b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:52.706347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-06225bbe-2586-403e-8f3a-82cebf6b142b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:52.876689 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-06225bbe-2586-403e-8f3a-82cebf6b142b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:52.895776 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-06225bbe-2586-403e-8f3a-82cebf6b142b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:52.898594 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-06225bbe-2586-403e-8f3a-82cebf6b142b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:52.900820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-06225bbe-2586-403e-8f3a-82cebf6b142b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.208531 Jul 18 10:50:52.901365 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 238/442] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:52 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:53.053151 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-03fc8f1d-94d6-4e73-b238-0a2b428a1411 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:53.054551 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-03fc8f1d-94d6-4e73-b238-0a2b428a1411 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:53.066713 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-03fc8f1d-94d6-4e73-b238-0a2b428a1411 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:53.067940 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-03fc8f1d-94d6-4e73-b238-0a2b428a1411 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:53.069126 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-03fc8f1d-94d6-4e73-b238-0a2b428a1411 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:53.069751 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-03fc8f1d-94d6-4e73-b238-0a2b428a1411 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:53.094457 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:53.251659 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-03fc8f1d-94d6-4e73-b238-0a2b428a1411 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:53.261270 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-03fc8f1d-94d6-4e73-b238-0a2b428a1411 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1454 microversion: 2.1 time: 0.212169 Jul 18 10:50:53.261860 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 205/443] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:53 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1454 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:53.282548 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-59bad97e-c230-421c-9e7d-6ba0344a4444 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:53.283274 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-59bad97e-c230-421c-9e7d-6ba0344a4444 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:53.290466 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-59bad97e-c230-421c-9e7d-6ba0344a4444 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:53.290961 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-59bad97e-c230-421c-9e7d-6ba0344a4444 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:53.291944 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-59bad97e-c230-421c-9e7d-6ba0344a4444 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:53.292459 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-59bad97e-c230-421c-9e7d-6ba0344a4444 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:53.466980 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-59bad97e-c230-421c-9e7d-6ba0344a4444 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:53.509543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-59bad97e-c230-421c-9e7d-6ba0344a4444 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1454 microversion: 2.1 time: 0.197605 Jul 18 10:50:53.509543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 239/444] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:53 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1454 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:53.559332 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-108e92f1-8c0f-4965-b3db-a4a38dfcb9f8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:53.560451 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-108e92f1-8c0f-4965-b3db-a4a38dfcb9f8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:53.568975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-108e92f1-8c0f-4965-b3db-a4a38dfcb9f8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:53.569698 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-108e92f1-8c0f-4965-b3db-a4a38dfcb9f8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:53.570646 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-108e92f1-8c0f-4965-b3db-a4a38dfcb9f8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:53.571583 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-108e92f1-8c0f-4965-b3db-a4a38dfcb9f8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:53.648952 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-108e92f1-8c0f-4965-b3db-a4a38dfcb9f8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:53.658625 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-108e92f1-8c0f-4965-b3db-a4a38dfcb9f8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1612 microversion: 2.1 time: 0.104640 Jul 18 10:50:53.660018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 206/445] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:53 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1612 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:53.675071 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0ea37d55-1ca9-43ff-86ab-0e85b1b2b096 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:53.675688 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-0ea37d55-1ca9-43ff-86ab-0e85b1b2b096 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:53.683264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0ea37d55-1ca9-43ff-86ab-0e85b1b2b096 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:53.683264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0ea37d55-1ca9-43ff-86ab-0e85b1b2b096 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:53.684290 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0ea37d55-1ca9-43ff-86ab-0e85b1b2b096 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:53.684290 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0ea37d55-1ca9-43ff-86ab-0e85b1b2b096 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:53.712320 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f5166fe3-93c3-47a0-812e-598c4571baf2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:53.713679 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f5166fe3-93c3-47a0-812e-598c4571baf2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:53.722367 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f5166fe3-93c3-47a0-812e-598c4571baf2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:53.722916 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f5166fe3-93c3-47a0-812e-598c4571baf2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:53.723899 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f5166fe3-93c3-47a0-812e-598c4571baf2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:53.724510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f5166fe3-93c3-47a0-812e-598c4571baf2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:53.841049 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f5166fe3-93c3-47a0-812e-598c4571baf2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:53.850007 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f5166fe3-93c3-47a0-812e-598c4571baf2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1194 microversion: 2.1 time: 0.143033 Jul 18 10:50:53.850799 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 207/446] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:53 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1194 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:53.895467 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-0ea37d55-1ca9-43ff-86ab-0e85b1b2b096 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:53.903830 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-0ea37d55-1ca9-43ff-86ab-0e85b1b2b096 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1664 microversion: 2.1 time: 0.232584 Jul 18 10:50:53.904404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 240/447] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:53 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1664 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:53.920403 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-ac170c6f-910c-4e1a-b584-fd809c190813 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:53.921046 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-ac170c6f-910c-4e1a-b584-fd809c190813 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:53.928034 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ac170c6f-910c-4e1a-b584-fd809c190813 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:53.928542 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ac170c6f-910c-4e1a-b584-fd809c190813 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:53.929352 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ac170c6f-910c-4e1a-b584-fd809c190813 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:53.929783 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ac170c6f-910c-4e1a-b584-fd809c190813 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:54.085879 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ac170c6f-910c-4e1a-b584-fd809c190813 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:54.101131 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ac170c6f-910c-4e1a-b584-fd809c190813 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:54.102799 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ac170c6f-910c-4e1a-b584-fd809c190813 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:54.104263 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-ac170c6f-910c-4e1a-b584-fd809c190813 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.187789 Jul 18 10:50:54.116516 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 208/448] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:53 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:50:54.677632 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b29eefaa-83cf-40e5-908f-0ffe49dd0c04 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:54.678220 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b29eefaa-83cf-40e5-908f-0ffe49dd0c04 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:54.680217 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=8 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:54.688087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b29eefaa-83cf-40e5-908f-0ffe49dd0c04 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:54.689080 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b29eefaa-83cf-40e5-908f-0ffe49dd0c04 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:54.690510 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b29eefaa-83cf-40e5-908f-0ffe49dd0c04 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:54.691188 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b29eefaa-83cf-40e5-908f-0ffe49dd0c04 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:54.771197 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b29eefaa-83cf-40e5-908f-0ffe49dd0c04 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:54.781314 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b29eefaa-83cf-40e5-908f-0ffe49dd0c04 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1612 microversion: 2.1 time: 0.107372 Jul 18 10:50:54.781941 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 241/449] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:54 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1612 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:54.866570 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-695d3efc-3dbb-41d7-8646-b24b8b4191dd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:54.867274 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-695d3efc-3dbb-41d7-8646-b24b8b4191dd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:54.875540 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-695d3efc-3dbb-41d7-8646-b24b8b4191dd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:54.877045 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-695d3efc-3dbb-41d7-8646-b24b8b4191dd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:54.878050 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-695d3efc-3dbb-41d7-8646-b24b8b4191dd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:54.878761 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-695d3efc-3dbb-41d7-8646-b24b8b4191dd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:54.933906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6e765a76-78d0-4c30-b400-10c7837005f7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:54.936688 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6e765a76-78d0-4c30-b400-10c7837005f7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:54.949502 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6e765a76-78d0-4c30-b400-10c7837005f7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:54.950396 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6e765a76-78d0-4c30-b400-10c7837005f7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:54.951479 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6e765a76-78d0-4c30-b400-10c7837005f7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:54.952283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6e765a76-78d0-4c30-b400-10c7837005f7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:54.966065 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-695d3efc-3dbb-41d7-8646-b24b8b4191dd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:54.981522 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-695d3efc-3dbb-41d7-8646-b24b8b4191dd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1194 microversion: 2.1 time: 0.116400 Jul 18 10:50:54.981522 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 209/450] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:54 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1194 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:55.128279 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bebfaffc-b03b-4146-8230-0f8509f2dc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:55.131302 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-bebfaffc-b03b-4146-8230-0f8509f2dc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:55.144212 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bebfaffc-b03b-4146-8230-0f8509f2dc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:55.144579 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bebfaffc-b03b-4146-8230-0f8509f2dc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:55.159924 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bebfaffc-b03b-4146-8230-0f8509f2dc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:55.160621 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bebfaffc-b03b-4146-8230-0f8509f2dc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:55.271025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-6e765a76-78d0-4c30-b400-10c7837005f7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:55.283193 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6e765a76-78d0-4c30-b400-10c7837005f7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1664 microversion: 2.1 time: 0.364717 Jul 18 10:50:55.284018 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 242/451] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:54 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1664 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:55.432956 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bebfaffc-b03b-4146-8230-0f8509f2dc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:55.442090 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bebfaffc-b03b-4146-8230-0f8509f2dc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:55.443978 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bebfaffc-b03b-4146-8230-0f8509f2dc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:55.445235 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-bebfaffc-b03b-4146-8230-0f8509f2dc1d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.325433 Jul 18 10:50:55.457061 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 210/452] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:55 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:55.800720 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3f7ae018-a255-42fc-8640-3b96dde6f27a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:55.803719 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3f7ae018-a255-42fc-8640-3b96dde6f27a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:55.819281 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3f7ae018-a255-42fc-8640-3b96dde6f27a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:55.820135 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3f7ae018-a255-42fc-8640-3b96dde6f27a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:55.822881 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3f7ae018-a255-42fc-8640-3b96dde6f27a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:55.823930 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3f7ae018-a255-42fc-8640-3b96dde6f27a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:55.865732 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3f7ae018-a255-42fc-8640-3b96dde6f27a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:55.866519 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3f7ae018-a255-42fc-8640-3b96dde6f27a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:55.867302 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-3f7ae018-a255-42fc-8640-3b96dde6f27a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lazy-loading 'fault' on Instance uuid 31366990-97f1-495a-98b8-0ff44a44f7e1 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:50:55.923794 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3f7ae018-a255-42fc-8640-3b96dde6f27a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:55.940557 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3f7ae018-a255-42fc-8640-3b96dde6f27a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1331 microversion: 2.1 time: 0.144995 Jul 18 10:50:55.951908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 243/453] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:55 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1331 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:55.998370 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6094ed2e-a4a2-4671-bd87-2e486577ea4d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:55.999350 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-6094ed2e-a4a2-4671-bd87-2e486577ea4d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:56.006261 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6094ed2e-a4a2-4671-bd87-2e486577ea4d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:56.006705 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6094ed2e-a4a2-4671-bd87-2e486577ea4d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:56.008881 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6094ed2e-a4a2-4671-bd87-2e486577ea4d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:56.008881 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6094ed2e-a4a2-4671-bd87-2e486577ea4d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:56.081898 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6094ed2e-a4a2-4671-bd87-2e486577ea4d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:56.089756 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-6094ed2e-a4a2-4671-bd87-2e486577ea4d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1204 microversion: 2.1 time: 0.095979 Jul 18 10:50:56.090823 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 211/454] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:55 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:56.306340 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2346c765-4599-4001-96c3-654f7c4b0d71 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:56.306340 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2346c765-4599-4001-96c3-654f7c4b0d71 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:56.317333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2346c765-4599-4001-96c3-654f7c4b0d71 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:56.317980 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2346c765-4599-4001-96c3-654f7c4b0d71 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:56.319984 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2346c765-4599-4001-96c3-654f7c4b0d71 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:56.320889 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2346c765-4599-4001-96c3-654f7c4b0d71 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:56.465960 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-26ba5fda-ab7e-4906-9404-664e50823735 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:56.467269 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-26ba5fda-ab7e-4906-9404-664e50823735 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:56.484366 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-26ba5fda-ab7e-4906-9404-664e50823735 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:56.484918 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-26ba5fda-ab7e-4906-9404-664e50823735 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:56.485697 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-26ba5fda-ab7e-4906-9404-664e50823735 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:56.486129 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-26ba5fda-ab7e-4906-9404-664e50823735 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:56.566315 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2346c765-4599-4001-96c3-654f7c4b0d71 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:56.572888 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:56.578233 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2346c765-4599-4001-96c3-654f7c4b0d71 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1664 microversion: 2.1 time: 0.280135 Jul 18 10:50:56.578925 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 244/455] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:56 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1664 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:56.691154 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-26ba5fda-ab7e-4906-9404-664e50823735 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:56.704138 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-26ba5fda-ab7e-4906-9404-664e50823735 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:56.706072 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-26ba5fda-ab7e-4906-9404-664e50823735 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:56.707797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-26ba5fda-ab7e-4906-9404-664e50823735 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.246688 Jul 18 10:50:56.708582 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 212/456] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:56 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:56.917208 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-cf9a715b-a9b2-48f1-adff-03005aae5a7b req-14f95504-f2e4-4578-9dbe-ce1aff8dddc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "309e30be-b4c2-4959-97f8-1ea7925c9e5c", "tag": "d0664086-9234-4f4b-a1d4-a34f998954fe"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:56.939697 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-cf9a715b-a9b2-48f1-adff-03005aae5a7b req-14f95504-f2e4-4578-9dbe-ce1aff8dddc7 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:56.940559 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-cf9a715b-a9b2-48f1-adff-03005aae5a7b req-14f95504-f2e4-4578-9dbe-ce1aff8dddc7 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:56.961044 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-990a2dd9-65e6-442e-9228-0272deabfd6d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:56.962373 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-990a2dd9-65e6-442e-9228-0272deabfd6d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:56.972826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-cf9a715b-a9b2-48f1-adff-03005aae5a7b req-14f95504-f2e4-4578-9dbe-ce1aff8dddc7 service nova] Creating event network-changed:d0664086-9234-4f4b-a1d4-a34f998954fe for instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c on hv-cinder-84949 Jul 18 10:50:56.977211 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-990a2dd9-65e6-442e-9228-0272deabfd6d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:56.977211 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-990a2dd9-65e6-442e-9228-0272deabfd6d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:56.977211 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-990a2dd9-65e6-442e-9228-0272deabfd6d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:56.977575 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-990a2dd9-65e6-442e-9228-0272deabfd6d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:56.980814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-cf9a715b-a9b2-48f1-adff-03005aae5a7b req-14f95504-f2e4-4578-9dbe-ce1aff8dddc7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069107 Jul 18 10:50:56.983104 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 245/457] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:57.052076 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-990a2dd9-65e6-442e-9228-0272deabfd6d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:57.055172 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-990a2dd9-65e6-442e-9228-0272deabfd6d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:57.055653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-990a2dd9-65e6-442e-9228-0272deabfd6d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lazy-loading 'fault' on Instance uuid 31366990-97f1-495a-98b8-0ff44a44f7e1 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:50:57.111519 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-50e5adaa-1590-4ee9-bde5-993906798ab4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:57.117429 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-50e5adaa-1590-4ee9-bde5-993906798ab4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:57.120408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-50e5adaa-1590-4ee9-bde5-993906798ab4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:57.121119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-50e5adaa-1590-4ee9-bde5-993906798ab4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:57.123172 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-50e5adaa-1590-4ee9-bde5-993906798ab4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:57.123781 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-50e5adaa-1590-4ee9-bde5-993906798ab4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:57.157206 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-990a2dd9-65e6-442e-9228-0272deabfd6d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:57.166099 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-990a2dd9-65e6-442e-9228-0272deabfd6d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 200 len: 1331 microversion: 2.1 time: 0.210235 Jul 18 10:50:57.166684 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 213/458] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:56 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 1331 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:57.358032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-50e5adaa-1590-4ee9-bde5-993906798ab4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:57.360314 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-50e5adaa-1590-4ee9-bde5-993906798ab4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1272 microversion: 2.1 time: 0.256558 Jul 18 10:50:57.360997 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 246/459] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:57 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1272 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:57.599596 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-4e8db632-049e-4047-816c-879114fe6f8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:57.600842 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-4e8db632-049e-4047-816c-879114fe6f8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:57.608542 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4e8db632-049e-4047-816c-879114fe6f8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:57.614206 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4e8db632-049e-4047-816c-879114fe6f8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:57.614206 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4e8db632-049e-4047-816c-879114fe6f8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:57.614206 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4e8db632-049e-4047-816c-879114fe6f8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:57.748715 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3bd69637-580d-49ea-be0a-d27aedb06f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:57.748715 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3bd69637-580d-49ea-be0a-d27aedb06f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:57.785445 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3bd69637-580d-49ea-be0a-d27aedb06f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:57.786243 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3bd69637-580d-49ea-be0a-d27aedb06f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:57.807129 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3bd69637-580d-49ea-be0a-d27aedb06f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:57.807129 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3bd69637-580d-49ea-be0a-d27aedb06f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:57.989292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4e8db632-049e-4047-816c-879114fe6f8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:57.999691 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-4e8db632-049e-4047-816c-879114fe6f8d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1664 microversion: 2.1 time: 0.407195 Jul 18 10:50:58.004590 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 214/460] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:57 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1664 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:58.155201 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3bd69637-580d-49ea-be0a-d27aedb06f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:58.167290 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3bd69637-580d-49ea-be0a-d27aedb06f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:58.178816 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3bd69637-580d-49ea-be0a-d27aedb06f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:58.178816 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3bd69637-580d-49ea-be0a-d27aedb06f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.452545 Jul 18 10:50:58.181229 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 247/461] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:57 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:58.185707 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-551ca392-7705-4b50-9739-cacd8ebea75f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:58.186340 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-551ca392-7705-4b50-9739-cacd8ebea75f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:58.194223 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-551ca392-7705-4b50-9739-cacd8ebea75f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:58.194959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-551ca392-7705-4b50-9739-cacd8ebea75f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:58.195931 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-551ca392-7705-4b50-9739-cacd8ebea75f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:58.196526 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-551ca392-7705-4b50-9739-cacd8ebea75f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:58.215250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-551ca392-7705-4b50-9739-cacd8ebea75f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] HTTP exception thrown: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-551ca392-7705-4b50-9739-cacd8ebea75f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Request method failure captured: Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 HTTP/1.1 Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1To3grVh5eba67sMHj3Z1DSA3fIUC9f5wIxOuVBPUD51Z7C3u9-HXpsXd8cB6k0mN-6p1y9OtAmiFcgdD3J1fX4g3yITPuNgpxLVfMocjGOIBC9EjXhO_0oCAHoqkj4rFWVIlBvaa2J_jvIj5l1Y1IoF1YPGIt2tFFq5BZ3pTrErcdc Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:50:58.222150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:50:58.223484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:50:58.223484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:50:58.223484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:50:58.223484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:50:58.223484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:50:58.223484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:50:58.223484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:50:58.223484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 3954fd4abf6b4c3a82280c762292a3e7 Jul 18 10:50:58.223484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:50:58.223484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:50:58.223484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. Jul 18 10:50:58.223484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '31366990-97f1-495a-98b8-0ff44a44f7e1'} Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:58.224214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. Jul 18 10:50:58.226405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:50:58.227700 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-551ca392-7705-4b50-9739-cacd8ebea75f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Returning 404 to user: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:58.227700 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-551ca392-7705-4b50-9739-cacd8ebea75f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 404 len: 111 microversion: 2.1 time: 0.039294 Jul 18 10:50:58.227700 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 215/462] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:58 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:50:58.231384 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3ea1ec6f-7dc3-45de-987b-aba00872f23a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '.version_select at 0x7f6364be81f0>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:58.349427 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-b7d869ff-b360-423e-9e55-92ad3a4ff251 req-93acf4ea-902c-4a8e-b9c1-eae193eb975c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dab0fce-91d6-4e37-970c-02ba8250d354", "tag": "251fff9b-71a7-49e1-bd58-5b46a671f255"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:58.368527 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3ea1ec6f-7dc3-45de-987b-aba00872f23a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734778831" status: 202 len: 0 microversion: 2.1 time: 0.141681 Jul 18 10:50:58.369647 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 248/463] 10.222.0.49 () {58 vars in 1220 bytes} [Mon Jul 18 10:50:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734778831 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:50:58.371934 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-b7d869ff-b360-423e-9e55-92ad3a4ff251 req-93acf4ea-902c-4a8e-b9c1-eae193eb975c service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:58.373337 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-b7d869ff-b360-423e-9e55-92ad3a4ff251 req-93acf4ea-902c-4a8e-b9c1-eae193eb975c service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:58.380812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-719125eb-b578-4001-a785-2570304592de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:58.381550 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-719125eb-b578-4001-a785-2570304592de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:58.394001 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-719125eb-b578-4001-a785-2570304592de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:58.396686 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-719125eb-b578-4001-a785-2570304592de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:58.397664 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-719125eb-b578-4001-a785-2570304592de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:58.399428 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-719125eb-b578-4001-a785-2570304592de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:58.406724 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-b7d869ff-b360-423e-9e55-92ad3a4ff251 req-93acf4ea-902c-4a8e-b9c1-eae193eb975c service nova] Creating event network-changed:251fff9b-71a7-49e1-bd58-5b46a671f255 for instance 3dab0fce-91d6-4e37-970c-02ba8250d354 on hv-cinder-84949 Jul 18 10:50:58.413875 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-b7d869ff-b360-423e-9e55-92ad3a4ff251 req-93acf4ea-902c-4a8e-b9c1-eae193eb975c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067135 Jul 18 10:50:58.415213 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 216/464] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:50:58.782802 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-719125eb-b578-4001-a785-2570304592de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:58.794323 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-719125eb-b578-4001-a785-2570304592de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1272 microversion: 2.1 time: 0.418071 Jul 18 10:50:58.795078 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 249/465] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:58 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1272 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:59.025843 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-02762a4d-9959-4a20-9bee-68174dc164f8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:59.025843 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-02762a4d-9959-4a20-9bee-68174dc164f8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:59.032220 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-02762a4d-9959-4a20-9bee-68174dc164f8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:59.032862 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-02762a4d-9959-4a20-9bee-68174dc164f8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:59.033822 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-02762a4d-9959-4a20-9bee-68174dc164f8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:59.037771 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-02762a4d-9959-4a20-9bee-68174dc164f8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:59.202164 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-70c7a628-b544-4e36-b8df-b9a450bea5a0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:59.202788 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-70c7a628-b544-4e36-b8df-b9a450bea5a0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:59.213226 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-70c7a628-b544-4e36-b8df-b9a450bea5a0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:59.213953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-70c7a628-b544-4e36-b8df-b9a450bea5a0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:59.215790 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-70c7a628-b544-4e36-b8df-b9a450bea5a0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:59.216540 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-70c7a628-b544-4e36-b8df-b9a450bea5a0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:59.370551 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-02762a4d-9959-4a20-9bee-68174dc164f8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:59.378850 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-02762a4d-9959-4a20-9bee-68174dc164f8 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1668 microversion: 2.1 time: 0.359535 Jul 18 10:50:59.379730 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 217/466] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:59 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1668 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:59.433031 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-70c7a628-b544-4e36-b8df-b9a450bea5a0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:59.442310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-70c7a628-b544-4e36-b8df-b9a450bea5a0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:59.443955 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-70c7a628-b544-4e36-b8df-b9a450bea5a0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:59.445135 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-70c7a628-b544-4e36-b8df-b9a450bea5a0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.249209 Jul 18 10:50:59.445677 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 250/467] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:59 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:50:59.663722 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-814421cc-d334-4f5f-8d7c-c9e1a473a789 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:59.668883 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-814421cc-d334-4f5f-8d7c-c9e1a473a789 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:59.672070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-814421cc-d334-4f5f-8d7c-c9e1a473a789 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:59.672524 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-814421cc-d334-4f5f-8d7c-c9e1a473a789 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:59.673353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-814421cc-d334-4f5f-8d7c-c9e1a473a789 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:59.673789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-814421cc-d334-4f5f-8d7c-c9e1a473a789 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:59.815372 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-814421cc-d334-4f5f-8d7c-c9e1a473a789 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lazy-loading 'services' on Instance uuid eadfa860-196c-4946-85a4-a9a2aed7c1b7 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:50:59.816021 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-df9cd527-2450-48cf-ade3-e097cc111225 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:59.816021 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-df9cd527-2450-48cf-ade3-e097cc111225 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:59.820721 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-df9cd527-2450-48cf-ade3-e097cc111225 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:59.821399 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-df9cd527-2450-48cf-ade3-e097cc111225 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:59.822906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-df9cd527-2450-48cf-ade3-e097cc111225 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:59.823485 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-df9cd527-2450-48cf-ade3-e097cc111225 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:00.050047 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-df9cd527-2450-48cf-ade3-e097cc111225 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:00.057544 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-df9cd527-2450-48cf-ade3-e097cc111225 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1272 microversion: 2.1 time: 0.248676 Jul 18 10:51:00.058074 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 251/468] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:59 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:00.073258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-580d042c-fd2d-4b56-9bad-e82e0d27f20e req-71b3a42e-9377-444b-88ee-808b299b2d5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d05192-b009-41ab-861b-b66d0352d41e", "name": "network-vif-plugged", "status": "completed", "tag": "abd1fe5c-3f12-4f5e-a659-6f5e05dab0ae"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:00.081789 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-580d042c-fd2d-4b56-9bad-e82e0d27f20e req-71b3a42e-9377-444b-88ee-808b299b2d5c service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:00.082225 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-580d042c-fd2d-4b56-9bad-e82e0d27f20e req-71b3a42e-9377-444b-88ee-808b299b2d5c service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:00.093930 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-580d042c-fd2d-4b56-9bad-e82e0d27f20e req-71b3a42e-9377-444b-88ee-808b299b2d5c service nova] Creating event network-vif-plugged:abd1fe5c-3f12-4f5e-a659-6f5e05dab0ae for instance 14d05192-b009-41ab-861b-b66d0352d41e on hv-cinder-84949 Jul 18 10:51:00.098790 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-580d042c-fd2d-4b56-9bad-e82e0d27f20e req-71b3a42e-9377-444b-88ee-808b299b2d5c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032086 Jul 18 10:51:00.099374 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 252/469] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:00.327363 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-814421cc-d334-4f5f-8d7c-c9e1a473a789 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "DELETE /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments/e80ea525-8bda-45d2-90e7-a5f905bbfed1" status: 202 len: 0 microversion: 2.1 time: 0.667516 Jul 18 10:51:00.329769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 218/470] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 18 10:50:59 2022] DELETE /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments/e80ea525-8bda-45d2-90e7-a5f905bbfed1 => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:51:00.354936 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6372ce4e-1458-4eff-8d29-a9a36af00dd9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:00.356569 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6372ce4e-1458-4eff-8d29-a9a36af00dd9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:00.363119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6372ce4e-1458-4eff-8d29-a9a36af00dd9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:00.363567 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6372ce4e-1458-4eff-8d29-a9a36af00dd9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:00.364367 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6372ce4e-1458-4eff-8d29-a9a36af00dd9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:00.364825 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6372ce4e-1458-4eff-8d29-a9a36af00dd9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:00.404503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6372ce4e-1458-4eff-8d29-a9a36af00dd9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046037 Jul 18 10:51:00.404503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 253/471] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:51:00 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:00.464299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-92daa0c5-5ee2-4d6e-8b86-14e28d70387b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:00.465548 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-92daa0c5-5ee2-4d6e-8b86-14e28d70387b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:00.475752 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-92daa0c5-5ee2-4d6e-8b86-14e28d70387b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:00.476233 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-92daa0c5-5ee2-4d6e-8b86-14e28d70387b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:00.477043 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-92daa0c5-5ee2-4d6e-8b86-14e28d70387b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:00.477467 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-92daa0c5-5ee2-4d6e-8b86-14e28d70387b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:00.880464 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-92daa0c5-5ee2-4d6e-8b86-14e28d70387b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:00.890315 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-92daa0c5-5ee2-4d6e-8b86-14e28d70387b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:00.891887 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-92daa0c5-5ee2-4d6e-8b86-14e28d70387b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:00.893110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-92daa0c5-5ee2-4d6e-8b86-14e28d70387b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.433137 Jul 18 10:51:00.893693 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 219/472] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:51:00 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:51:01.079129 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-012c8305-8c3f-4758-806f-cfdf82ff7b14 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:01.079870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-012c8305-8c3f-4758-806f-cfdf82ff7b14 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:01.086024 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-012c8305-8c3f-4758-806f-cfdf82ff7b14 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:01.086466 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-012c8305-8c3f-4758-806f-cfdf82ff7b14 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:01.087224 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-012c8305-8c3f-4758-806f-cfdf82ff7b14 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:01.087655 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-012c8305-8c3f-4758-806f-cfdf82ff7b14 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:01.226323 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-012c8305-8c3f-4758-806f-cfdf82ff7b14 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:01.234457 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-012c8305-8c3f-4758-806f-cfdf82ff7b14 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1272 microversion: 2.1 time: 0.160088 Jul 18 10:51:01.235026 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 254/473] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:01 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:01.414950 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-224c5bc2-338a-40f1-ac3d-c4c8a53494a8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:01.415941 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-224c5bc2-338a-40f1-ac3d-c4c8a53494a8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:01.423167 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-224c5bc2-338a-40f1-ac3d-c4c8a53494a8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:01.423540 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-224c5bc2-338a-40f1-ac3d-c4c8a53494a8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:01.424425 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-224c5bc2-338a-40f1-ac3d-c4c8a53494a8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:01.424800 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-224c5bc2-338a-40f1-ac3d-c4c8a53494a8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:01.454447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-224c5bc2-338a-40f1-ac3d-c4c8a53494a8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043522 Jul 18 10:51:01.455012 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 220/474] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:51:01 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:01.912265 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-fbc352dc-7021-4304-8ea8-0d2631c4f825 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:01.912912 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-fbc352dc-7021-4304-8ea8-0d2631c4f825 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:01.916097 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:01.921824 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fbc352dc-7021-4304-8ea8-0d2631c4f825 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:01.922525 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fbc352dc-7021-4304-8ea8-0d2631c4f825 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:01.923349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fbc352dc-7021-4304-8ea8-0d2631c4f825 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:01.923889 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fbc352dc-7021-4304-8ea8-0d2631c4f825 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:02.069896 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-fbc352dc-7021-4304-8ea8-0d2631c4f825 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:02.080333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-fbc352dc-7021-4304-8ea8-0d2631c4f825 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:02.081855 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-fbc352dc-7021-4304-8ea8-0d2631c4f825 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:02.083070 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-fbc352dc-7021-4304-8ea8-0d2631c4f825 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.175497 Jul 18 10:51:02.094552 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 255/475] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:51:01 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:51:02.252020 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-4da083e6-3246-4db1-bbff-d84ce36be46b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:02.252541 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-4da083e6-3246-4db1-bbff-d84ce36be46b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:02.263148 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4da083e6-3246-4db1-bbff-d84ce36be46b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:02.263607 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4da083e6-3246-4db1-bbff-d84ce36be46b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:02.264367 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4da083e6-3246-4db1-bbff-d84ce36be46b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:02.264830 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4da083e6-3246-4db1-bbff-d84ce36be46b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:02.421243 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4da083e6-3246-4db1-bbff-d84ce36be46b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:02.430124 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-4da083e6-3246-4db1-bbff-d84ce36be46b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1272 microversion: 2.1 time: 0.181983 Jul 18 10:51:02.430699 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 221/476] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:02 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:02.470293 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-71018867-6f2f-45a5-9946-b757d04fa8c8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:02.471239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-71018867-6f2f-45a5-9946-b757d04fa8c8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:02.477900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-71018867-6f2f-45a5-9946-b757d04fa8c8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:02.478346 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-71018867-6f2f-45a5-9946-b757d04fa8c8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:02.479130 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-71018867-6f2f-45a5-9946-b757d04fa8c8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:02.479570 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-71018867-6f2f-45a5-9946-b757d04fa8c8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:02.513958 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-71018867-6f2f-45a5-9946-b757d04fa8c8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049775 Jul 18 10:51:02.515043 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 256/477] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:51:02 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:03.102819 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-556733e8-3592-4ddf-8877-e51c5b71890d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:03.103432 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-556733e8-3592-4ddf-8877-e51c5b71890d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:03.110412 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-556733e8-3592-4ddf-8877-e51c5b71890d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:03.110858 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-556733e8-3592-4ddf-8877-e51c5b71890d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:03.111641 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-556733e8-3592-4ddf-8877-e51c5b71890d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:03.112074 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-556733e8-3592-4ddf-8877-e51c5b71890d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:03.128379 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:03.251202 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-556733e8-3592-4ddf-8877-e51c5b71890d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:03.259562 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-556733e8-3592-4ddf-8877-e51c5b71890d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:03.261107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-556733e8-3592-4ddf-8877-e51c5b71890d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:03.263256 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-556733e8-3592-4ddf-8877-e51c5b71890d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.164527 Jul 18 10:51:03.263852 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 222/478] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:51:03 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:51:03.451186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9d554f68-ce58-4ef2-9e4c-c4da80fc14c5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:03.455306 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9d554f68-ce58-4ef2-9e4c-c4da80fc14c5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:03.459918 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9d554f68-ce58-4ef2-9e4c-c4da80fc14c5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:03.460332 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9d554f68-ce58-4ef2-9e4c-c4da80fc14c5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:03.461707 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9d554f68-ce58-4ef2-9e4c-c4da80fc14c5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:03.462219 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9d554f68-ce58-4ef2-9e4c-c4da80fc14c5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:03.527439 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-84ba3683-95b1-4ebb-9a25-7fec27c44e74 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:03.529067 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-84ba3683-95b1-4ebb-9a25-7fec27c44e74 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:03.538676 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-84ba3683-95b1-4ebb-9a25-7fec27c44e74 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:03.539123 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-84ba3683-95b1-4ebb-9a25-7fec27c44e74 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:03.540087 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-84ba3683-95b1-4ebb-9a25-7fec27c44e74 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:03.540518 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-84ba3683-95b1-4ebb-9a25-7fec27c44e74 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:03.575870 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-84ba3683-95b1-4ebb-9a25-7fec27c44e74 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053419 Jul 18 10:51:03.580215 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 223/479] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:51:03 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:51:03.629528 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9d554f68-ce58-4ef2-9e4c-c4da80fc14c5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:03.638454 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9d554f68-ce58-4ef2-9e4c-c4da80fc14c5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1272 microversion: 2.1 time: 0.194001 Jul 18 10:51:03.639196 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 257/480] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:03 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:04.283931 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-36c2de08-d2f4-4821-8dce-b22d162670ad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:04.284620 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-36c2de08-d2f4-4821-8dce-b22d162670ad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:04.291693 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-36c2de08-d2f4-4821-8dce-b22d162670ad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:04.292262 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-36c2de08-d2f4-4821-8dce-b22d162670ad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:04.294375 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-36c2de08-d2f4-4821-8dce-b22d162670ad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:04.294978 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-36c2de08-d2f4-4821-8dce-b22d162670ad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:04.436608 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-36c2de08-d2f4-4821-8dce-b22d162670ad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:04.449838 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-36c2de08-d2f4-4821-8dce-b22d162670ad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:04.449838 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-36c2de08-d2f4-4821-8dce-b22d162670ad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:04.449838 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-36c2de08-d2f4-4821-8dce-b22d162670ad tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1808 microversion: 2.20 time: 0.168736 Jul 18 10:51:04.450176 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 224/481] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:51:04 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:51:04.588438 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-419b2516-aab8-4052-915f-e9dea6dd3c5d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:04.589408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-419b2516-aab8-4052-915f-e9dea6dd3c5d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:04.597525 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-419b2516-aab8-4052-915f-e9dea6dd3c5d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:04.597971 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-419b2516-aab8-4052-915f-e9dea6dd3c5d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:04.598875 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-419b2516-aab8-4052-915f-e9dea6dd3c5d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:04.599310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-419b2516-aab8-4052-915f-e9dea6dd3c5d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:04.635737 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-419b2516-aab8-4052-915f-e9dea6dd3c5d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051768 Jul 18 10:51:04.636335 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 258/482] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:51:04 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:04.656927 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-171210ad-df42-47ce-bde6-a66390fb4ee0 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:04.657814 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-171210ad-df42-47ce-bde6-a66390fb4ee0 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:04.664853 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-171210ad-df42-47ce-bde6-a66390fb4ee0 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:04.665300 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-171210ad-df42-47ce-bde6-a66390fb4ee0 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:04.666078 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-171210ad-df42-47ce-bde6-a66390fb4ee0 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:04.666510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-171210ad-df42-47ce-bde6-a66390fb4ee0 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:04.811535 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-171210ad-df42-47ce-bde6-a66390fb4ee0 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:04.819413 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-171210ad-df42-47ce-bde6-a66390fb4ee0 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1272 microversion: 2.1 time: 0.167186 Jul 18 10:51:04.819982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 225/483] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:04 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:04.982051 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-1222c3fc-1227-4270-8396-656a911c3f1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:04.983146 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-1222c3fc-1227-4270-8396-656a911c3f1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:04.991838 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1222c3fc-1227-4270-8396-656a911c3f1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:04.992573 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1222c3fc-1227-4270-8396-656a911c3f1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:04.993407 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1222c3fc-1227-4270-8396-656a911c3f1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:04.993842 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1222c3fc-1227-4270-8396-656a911c3f1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:05.018819 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-1222c3fc-1227-4270-8396-656a911c3f1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lazy-loading 'flavor' on Instance uuid 48a4f543-a994-4897-8ced-5c04fed9ef50 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:51:05.470285 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f9814b1a-6bcc-4012-af60-f38049ccbfb6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:05.470890 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f9814b1a-6bcc-4012-af60-f38049ccbfb6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:05.477672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f9814b1a-6bcc-4012-af60-f38049ccbfb6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:05.478116 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f9814b1a-6bcc-4012-af60-f38049ccbfb6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:05.478869 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f9814b1a-6bcc-4012-af60-f38049ccbfb6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:05.479297 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f9814b1a-6bcc-4012-af60-f38049ccbfb6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:05.548905 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-1222c3fc-1227-4270-8396-656a911c3f1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "POST /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/action" status: 200 len: 32 microversion: 2.1 time: 0.571062 Jul 18 10:51:05.549863 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 259/484] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 18 10:51:04 2022] POST /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/action => generated 32 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:51:05.559547 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-c09ec67a-2365-4a4d-b285-90ecf1c657a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:05.560264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-c09ec67a-2365-4a4d-b285-90ecf1c657a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:05.567058 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c09ec67a-2365-4a4d-b285-90ecf1c657a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:05.567574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c09ec67a-2365-4a4d-b285-90ecf1c657a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:05.568521 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c09ec67a-2365-4a4d-b285-90ecf1c657a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:05.568840 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c09ec67a-2365-4a4d-b285-90ecf1c657a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:05.661995 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f9814b1a-6bcc-4012-af60-f38049ccbfb6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:05.672353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f9814b1a-6bcc-4012-af60-f38049ccbfb6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:05.678434 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f9814b1a-6bcc-4012-af60-f38049ccbfb6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:05.679650 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f9814b1a-6bcc-4012-af60-f38049ccbfb6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1795 microversion: 2.20 time: 0.215858 Jul 18 10:51:05.680216 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 226/485] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:51:05 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1795 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:51:05.685480 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e8a36c8c-c213-431e-b04e-46d2906b104f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:05.686617 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e8a36c8c-c213-431e-b04e-46d2906b104f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:05.693681 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e8a36c8c-c213-431e-b04e-46d2906b104f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:05.694129 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e8a36c8c-c213-431e-b04e-46d2906b104f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:05.694982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e8a36c8c-c213-431e-b04e-46d2906b104f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:05.695341 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e8a36c8c-c213-431e-b04e-46d2906b104f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:05.726908 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e8a36c8c-c213-431e-b04e-46d2906b104f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045398 Jul 18 10:51:05.727484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 227/486] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:51:05 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:05.733601 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c09ec67a-2365-4a4d-b285-90ecf1c657a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:05.742997 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-c09ec67a-2365-4a4d-b285-90ecf1c657a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.187884 Jul 18 10:51:05.743852 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 260/487] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:05 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:05.837834 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8b2f2c16-e33c-44e0-a893-e5dc264945fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:05.838474 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8b2f2c16-e33c-44e0-a893-e5dc264945fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:05.847086 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8b2f2c16-e33c-44e0-a893-e5dc264945fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:05.847527 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8b2f2c16-e33c-44e0-a893-e5dc264945fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:05.848353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8b2f2c16-e33c-44e0-a893-e5dc264945fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:05.848802 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8b2f2c16-e33c-44e0-a893-e5dc264945fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:06.102424 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8b2f2c16-e33c-44e0-a893-e5dc264945fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:06.110274 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8b2f2c16-e33c-44e0-a893-e5dc264945fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1272 microversion: 2.1 time: 0.276527 Jul 18 10:51:06.110841 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 228/488] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:05 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:06.740938 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-7c1bef53-8488-4abf-b5b3-61778f4e3631 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:06.741933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-7c1bef53-8488-4abf-b5b3-61778f4e3631 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:06.748673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7c1bef53-8488-4abf-b5b3-61778f4e3631 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:06.749231 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7c1bef53-8488-4abf-b5b3-61778f4e3631 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:06.750003 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7c1bef53-8488-4abf-b5b3-61778f4e3631 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:06.750439 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7c1bef53-8488-4abf-b5b3-61778f4e3631 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:06.762354 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e83943d0-2e97-4775-a70a-94489da8bc69 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:06.763470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e83943d0-2e97-4775-a70a-94489da8bc69 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:06.770691 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e83943d0-2e97-4775-a70a-94489da8bc69 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:06.771960 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e83943d0-2e97-4775-a70a-94489da8bc69 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:06.773342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e83943d0-2e97-4775-a70a-94489da8bc69 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:06.773951 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e83943d0-2e97-4775-a70a-94489da8bc69 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:06.779454 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:06.786390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-7c1bef53-8488-4abf-b5b3-61778f4e3631 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049422 Jul 18 10:51:06.787279 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 261/489] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:51:06 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:06.923589 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e83943d0-2e97-4775-a70a-94489da8bc69 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:06.932491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e83943d0-2e97-4775-a70a-94489da8bc69 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.174459 Jul 18 10:51:06.933460 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 229/490] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:06 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:07.127630 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-567aca19-8375-4d30-987f-2b1343f4ed8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:07.128152 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-567aca19-8375-4d30-987f-2b1343f4ed8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:07.134916 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-567aca19-8375-4d30-987f-2b1343f4ed8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:07.135357 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-567aca19-8375-4d30-987f-2b1343f4ed8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:07.136158 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-567aca19-8375-4d30-987f-2b1343f4ed8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:07.137877 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-567aca19-8375-4d30-987f-2b1343f4ed8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:07.278129 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-567aca19-8375-4d30-987f-2b1343f4ed8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:07.286087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-567aca19-8375-4d30-987f-2b1343f4ed8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1260 microversion: 2.1 time: 0.162398 Jul 18 10:51:07.286688 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 262/491] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:07 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:07.798569 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-18563cd1-ce37-4a03-af08-5c11bc699515 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:07.799581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-18563cd1-ce37-4a03-af08-5c11bc699515 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:07.807615 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18563cd1-ce37-4a03-af08-5c11bc699515 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:07.808065 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18563cd1-ce37-4a03-af08-5c11bc699515 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:07.809116 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18563cd1-ce37-4a03-af08-5c11bc699515 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:07.809575 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18563cd1-ce37-4a03-af08-5c11bc699515 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:07.838920 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-18563cd1-ce37-4a03-af08-5c11bc699515 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044323 Jul 18 10:51:07.840083 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 230/492] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:51:07 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 10:51:07.901663 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6ea8af28-bb41-40c5-8678-8eb896422b7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:07.903145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6ea8af28-bb41-40c5-8678-8eb896422b7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:07.909724 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6ea8af28-bb41-40c5-8678-8eb896422b7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:07.910172 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6ea8af28-bb41-40c5-8678-8eb896422b7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:07.910937 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6ea8af28-bb41-40c5-8678-8eb896422b7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:07.911372 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6ea8af28-bb41-40c5-8678-8eb896422b7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:07.939579 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6ea8af28-bb41-40c5-8678-8eb896422b7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Going to try to terminate instance {{(pid=125007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:51:07.950666 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-207b95f6-7961-4828-9bfa-60b7d3d1c57d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:07.951270 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-207b95f6-7961-4828-9bfa-60b7d3d1c57d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:07.957648 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-207b95f6-7961-4828-9bfa-60b7d3d1c57d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:07.958091 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-207b95f6-7961-4828-9bfa-60b7d3d1c57d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:07.958860 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-207b95f6-7961-4828-9bfa-60b7d3d1c57d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:07.959290 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-207b95f6-7961-4828-9bfa-60b7d3d1c57d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:08.114141 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-207b95f6-7961-4828-9bfa-60b7d3d1c57d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:08.122701 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-207b95f6-7961-4828-9bfa-60b7d3d1c57d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.175799 Jul 18 10:51:08.123304 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 231/493] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:07 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:08.304526 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-541b888d-b66f-4902-b8b5-3aeb3fe3aa5f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:08.304526 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-541b888d-b66f-4902-b8b5-3aeb3fe3aa5f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:08.318301 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-541b888d-b66f-4902-b8b5-3aeb3fe3aa5f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:08.318954 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-541b888d-b66f-4902-b8b5-3aeb3fe3aa5f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:08.319760 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-541b888d-b66f-4902-b8b5-3aeb3fe3aa5f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:08.320194 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-541b888d-b66f-4902-b8b5-3aeb3fe3aa5f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:08.395991 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6ea8af28-bb41-40c5-8678-8eb896422b7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "DELETE /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 204 len: 0 microversion: 2.1 time: 0.497854 Jul 18 10:51:08.396894 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 263/494] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:51:07 2022] DELETE /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:51:08.406768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b040edcb-c839-4683-80ad-4647801ec7ca tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:08.407487 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b040edcb-c839-4683-80ad-4647801ec7ca tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:08.416155 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b040edcb-c839-4683-80ad-4647801ec7ca tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:08.416766 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b040edcb-c839-4683-80ad-4647801ec7ca tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:08.417771 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b040edcb-c839-4683-80ad-4647801ec7ca tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:08.418254 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b040edcb-c839-4683-80ad-4647801ec7ca tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:08.546724 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-541b888d-b66f-4902-b8b5-3aeb3fe3aa5f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:08.555274 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-541b888d-b66f-4902-b8b5-3aeb3fe3aa5f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1260 microversion: 2.1 time: 0.255499 Jul 18 10:51:08.555858 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 232/495] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:08 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1260 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:08.600383 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b040edcb-c839-4683-80ad-4647801ec7ca tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:08.608649 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b040edcb-c839-4683-80ad-4647801ec7ca tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1679 microversion: 2.1 time: 0.206926 Jul 18 10:51:08.609248 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 264/496] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:08 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1679 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:09.140858 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-474f9e11-c683-4226-9fdc-c615c5e78f36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:09.141455 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-474f9e11-c683-4226-9fdc-c615c5e78f36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:09.147901 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-474f9e11-c683-4226-9fdc-c615c5e78f36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:09.148339 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-474f9e11-c683-4226-9fdc-c615c5e78f36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:09.149111 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-474f9e11-c683-4226-9fdc-c615c5e78f36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:09.149537 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-474f9e11-c683-4226-9fdc-c615c5e78f36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:09.284937 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-474f9e11-c683-4226-9fdc-c615c5e78f36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:09.293635 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-474f9e11-c683-4226-9fdc-c615c5e78f36 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.156446 Jul 18 10:51:09.294260 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 233/497] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:09 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:09.573694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-802b70d3-1d20-4a5e-be8b-3a6d6d8d22a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:09.575134 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-802b70d3-1d20-4a5e-be8b-3a6d6d8d22a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:09.583333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-802b70d3-1d20-4a5e-be8b-3a6d6d8d22a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:09.583805 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-802b70d3-1d20-4a5e-be8b-3a6d6d8d22a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:09.584583 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-802b70d3-1d20-4a5e-be8b-3a6d6d8d22a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:09.585192 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-802b70d3-1d20-4a5e-be8b-3a6d6d8d22a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:09.626824 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-77b53938-7d66-4e8a-a97a-0da9e26723a7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:09.627444 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-77b53938-7d66-4e8a-a97a-0da9e26723a7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:09.634287 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-77b53938-7d66-4e8a-a97a-0da9e26723a7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:09.634797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-77b53938-7d66-4e8a-a97a-0da9e26723a7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:09.635526 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-77b53938-7d66-4e8a-a97a-0da9e26723a7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:09.636763 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-77b53938-7d66-4e8a-a97a-0da9e26723a7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:09.788765 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-802b70d3-1d20-4a5e-be8b-3a6d6d8d22a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:09.803375 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-802b70d3-1d20-4a5e-be8b-3a6d6d8d22a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1260 microversion: 2.1 time: 0.233553 Jul 18 10:51:09.804588 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 265/498] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:09 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:09.826228 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-77b53938-7d66-4e8a-a97a-0da9e26723a7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:09.834090 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-77b53938-7d66-4e8a-a97a-0da9e26723a7 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1679 microversion: 2.1 time: 0.211216 Jul 18 10:51:09.834688 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 234/499] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:09 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:10.312133 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8621f7be-38fb-43a7-aaea-01e2f2976bf8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:10.312828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-8621f7be-38fb-43a7-aaea-01e2f2976bf8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:10.319102 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8621f7be-38fb-43a7-aaea-01e2f2976bf8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:10.319543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8621f7be-38fb-43a7-aaea-01e2f2976bf8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:10.320316 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8621f7be-38fb-43a7-aaea-01e2f2976bf8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:10.320769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8621f7be-38fb-43a7-aaea-01e2f2976bf8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:10.456647 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-8621f7be-38fb-43a7-aaea-01e2f2976bf8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:10.465003 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-8621f7be-38fb-43a7-aaea-01e2f2976bf8 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.157171 Jul 18 10:51:10.465579 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 266/500] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:10 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:10.821588 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-017a4e66-d0cd-4e0c-b363-0f22bd86a38c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:10.822290 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-017a4e66-d0cd-4e0c-b363-0f22bd86a38c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:10.829782 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-017a4e66-d0cd-4e0c-b363-0f22bd86a38c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:10.830165 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-017a4e66-d0cd-4e0c-b363-0f22bd86a38c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:10.830948 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-017a4e66-d0cd-4e0c-b363-0f22bd86a38c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:10.831387 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-017a4e66-d0cd-4e0c-b363-0f22bd86a38c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:10.859582 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d9587a6c-6960-424c-aea2-50b666971002 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:10.860829 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d9587a6c-6960-424c-aea2-50b666971002 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:10.873240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d9587a6c-6960-424c-aea2-50b666971002 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:10.874357 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d9587a6c-6960-424c-aea2-50b666971002 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:10.876424 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d9587a6c-6960-424c-aea2-50b666971002 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:10.876424 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d9587a6c-6960-424c-aea2-50b666971002 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:11.174180 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-017a4e66-d0cd-4e0c-b363-0f22bd86a38c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:11.180199 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d9587a6c-6960-424c-aea2-50b666971002 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:11.182714 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-017a4e66-d0cd-4e0c-b363-0f22bd86a38c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1260 microversion: 2.1 time: 0.365213 Jul 18 10:51:11.183723 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 235/501] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:10 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1260 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:11.195469 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d9587a6c-6960-424c-aea2-50b666971002 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1679 microversion: 2.1 time: 0.344942 Jul 18 10:51:11.196058 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 267/502] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:10 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1679 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:11.486944 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a85c1e55-a71d-473b-b612-56e500a239cf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:11.488213 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a85c1e55-a71d-473b-b612-56e500a239cf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:11.494666 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a85c1e55-a71d-473b-b612-56e500a239cf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:11.495109 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a85c1e55-a71d-473b-b612-56e500a239cf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:11.496442 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a85c1e55-a71d-473b-b612-56e500a239cf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:11.497621 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a85c1e55-a71d-473b-b612-56e500a239cf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:11.734193 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a85c1e55-a71d-473b-b612-56e500a239cf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:11.743100 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a85c1e55-a71d-473b-b612-56e500a239cf tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.263346 Jul 18 10:51:11.743692 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 236/503] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:11 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:11.874640 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-b5b831a3-e1e2-43d0-941b-e6a3ef38c33e req-299cbdf8-f9db-45ea-9292-a7cb04fe41cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eadfa860-196c-4946-85a4-a9a2aed7c1b7", "name": "network-vif-deleted", "tag": "dce7face-5f9b-40f7-8b3c-e6b845457a5e"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:11.884217 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-b5b831a3-e1e2-43d0-941b-e6a3ef38c33e req-299cbdf8-f9db-45ea-9292-a7cb04fe41cb service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:11.884486 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-b5b831a3-e1e2-43d0-941b-e6a3ef38c33e req-299cbdf8-f9db-45ea-9292-a7cb04fe41cb service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:11.899349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-b5b831a3-e1e2-43d0-941b-e6a3ef38c33e req-299cbdf8-f9db-45ea-9292-a7cb04fe41cb service nova] Creating event network-vif-deleted:dce7face-5f9b-40f7-8b3c-e6b845457a5e for instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 on hv-cinder-84949 Jul 18 10:51:11.904709 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-b5b831a3-e1e2-43d0-941b-e6a3ef38c33e req-299cbdf8-f9db-45ea-9292-a7cb04fe41cb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034880 Jul 18 10:51:11.905694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 268/504] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:51:12.200114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-58b927c3-a24d-4591-8747-670a9ad4ec0b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:12.200890 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-58b927c3-a24d-4591-8747-670a9ad4ec0b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:12.206985 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-58b927c3-a24d-4591-8747-670a9ad4ec0b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:12.207433 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-58b927c3-a24d-4591-8747-670a9ad4ec0b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:12.208225 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-58b927c3-a24d-4591-8747-670a9ad4ec0b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:12.208985 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-58b927c3-a24d-4591-8747-670a9ad4ec0b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:12.222149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-124812e0-fd4a-4279-8b85-179d86ce5d1c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:12.223606 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-124812e0-fd4a-4279-8b85-179d86ce5d1c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:12.236343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-124812e0-fd4a-4279-8b85-179d86ce5d1c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:12.236840 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-124812e0-fd4a-4279-8b85-179d86ce5d1c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:12.237646 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-124812e0-fd4a-4279-8b85-179d86ce5d1c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:12.238342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-124812e0-fd4a-4279-8b85-179d86ce5d1c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:12.328243 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-124812e0-fd4a-4279-8b85-179d86ce5d1c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:12.336346 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-124812e0-fd4a-4279-8b85-179d86ce5d1c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1611 microversion: 2.1 time: 0.125577 Jul 18 10:51:12.337201 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 269/505] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:12 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1611 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:12.397574 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-58b927c3-a24d-4591-8747-670a9ad4ec0b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:12.406979 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-58b927c3-a24d-4591-8747-670a9ad4ec0b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1260 microversion: 2.1 time: 0.211360 Jul 18 10:51:12.407604 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 237/506] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:12 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:12.762096 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e2bc7120-7977-48df-ab94-fba642ff115f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:12.762821 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-e2bc7120-7977-48df-ab94-fba642ff115f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:12.769927 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e2bc7120-7977-48df-ab94-fba642ff115f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:12.770646 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e2bc7120-7977-48df-ab94-fba642ff115f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:12.771439 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e2bc7120-7977-48df-ab94-fba642ff115f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:12.771924 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e2bc7120-7977-48df-ab94-fba642ff115f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:12.927574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e2bc7120-7977-48df-ab94-fba642ff115f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:12.936660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e2bc7120-7977-48df-ab94-fba642ff115f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.179633 Jul 18 10:51:12.937277 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 270/507] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:12 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:13.355094 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2fe736a9-6522-40d3-9acd-c457aacf520d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:13.355731 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2fe736a9-6522-40d3-9acd-c457aacf520d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:13.362739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2fe736a9-6522-40d3-9acd-c457aacf520d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:13.363185 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2fe736a9-6522-40d3-9acd-c457aacf520d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:13.363950 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2fe736a9-6522-40d3-9acd-c457aacf520d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:13.364464 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2fe736a9-6522-40d3-9acd-c457aacf520d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:13.399288 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2fe736a9-6522-40d3-9acd-c457aacf520d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:13.399733 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2fe736a9-6522-40d3-9acd-c457aacf520d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:13.400328 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-2fe736a9-6522-40d3-9acd-c457aacf520d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lazy-loading 'fault' on Instance uuid eadfa860-196c-4946-85a4-a9a2aed7c1b7 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:51:13.424118 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-696228d5-ac76-480e-b24e-897d6c21ba33 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:13.425152 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-696228d5-ac76-480e-b24e-897d6c21ba33 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:13.437828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-696228d5-ac76-480e-b24e-897d6c21ba33 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:13.438618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-696228d5-ac76-480e-b24e-897d6c21ba33 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:13.439616 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-696228d5-ac76-480e-b24e-897d6c21ba33 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:13.440115 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-696228d5-ac76-480e-b24e-897d6c21ba33 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:13.442959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-2fe736a9-6522-40d3-9acd-c457aacf520d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:13.445590 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=100 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:13.452703 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2fe736a9-6522-40d3-9acd-c457aacf520d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 200 len: 1329 microversion: 2.1 time: 0.101594 Jul 18 10:51:13.453848 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 238/508] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:13 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 1329 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:13.591407 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-696228d5-ac76-480e-b24e-897d6c21ba33 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:13.599447 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-696228d5-ac76-480e-b24e-897d6c21ba33 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1260 microversion: 2.1 time: 0.179365 Jul 18 10:51:13.600035 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 271/509] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:13 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:13.954679 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a42f3e89-6de8-4eb2-8563-473e21bdfa8a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:13.955300 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a42f3e89-6de8-4eb2-8563-473e21bdfa8a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:13.965792 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a42f3e89-6de8-4eb2-8563-473e21bdfa8a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:13.965792 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a42f3e89-6de8-4eb2-8563-473e21bdfa8a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:13.965792 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a42f3e89-6de8-4eb2-8563-473e21bdfa8a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:13.965792 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a42f3e89-6de8-4eb2-8563-473e21bdfa8a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:14.103779 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a42f3e89-6de8-4eb2-8563-473e21bdfa8a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:14.113411 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a42f3e89-6de8-4eb2-8563-473e21bdfa8a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.162585 Jul 18 10:51:14.118576 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 239/510] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:13 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:14.473910 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-65662ffc-07fa-4544-a990-d67fd4be889a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:14.474507 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-65662ffc-07fa-4544-a990-d67fd4be889a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:14.481944 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-65662ffc-07fa-4544-a990-d67fd4be889a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:14.482391 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-65662ffc-07fa-4544-a990-d67fd4be889a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:14.483158 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-65662ffc-07fa-4544-a990-d67fd4be889a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:14.483590 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-65662ffc-07fa-4544-a990-d67fd4be889a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:14.498166 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-65662ffc-07fa-4544-a990-d67fd4be889a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] HTTP exception thrown: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-65662ffc-07fa-4544-a990-d67fd4be889a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Request method failure captured: Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 HTTP/1.1 Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To3grVh5eba67sMHj3Z1DSA3fIUC9f5wIxOuVBPUD51Z7C3u9-HXpsXd8cB6k0mN-6p1y9OtAmiFcgdD3J1fX4g3yITPuNgpxLVfMocjGOIBC9EjXhO_0oCAHoqkj4rFWVIlBvaa2J_jvIj5l1Y1IoF1YPGIt2tFFq5BZ3pTrErcdc Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:51:14.499828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:51:14.501408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:51:14.501408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:51:14.501408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:51:14.501408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:51:14.501408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:51:14.501408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:51:14.501408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:51:14.501408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 3954fd4abf6b4c3a82280c762292a3e7 Jul 18 10:51:14.501408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:51:14.501408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:51:14.501408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. Jul 18 10:51:14.501408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': 'eadfa860-196c-4946-85a4-a9a2aed7c1b7'} Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:51:14.502360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. Jul 18 10:51:14.503722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:51:14.504977 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-65662ffc-07fa-4544-a990-d67fd4be889a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Returning 404 to user: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:51:14.504977 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-65662ffc-07fa-4544-a990-d67fd4be889a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 404 len: 111 microversion: 2.1 time: 0.031222 Jul 18 10:51:14.504977 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 272/511] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:14 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:51:14.510152 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b9288b7d-5182-4986-b52a-9743c1a014bb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '.version_select at 0x7f6364d23af0>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:14.617845 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-008f47ef-0540-4833-99df-559d2c4d162f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:14.618545 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-008f47ef-0540-4833-99df-559d2c4d162f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:14.625605 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-008f47ef-0540-4833-99df-559d2c4d162f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:14.626059 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-008f47ef-0540-4833-99df-559d2c4d162f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:14.626845 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-008f47ef-0540-4833-99df-559d2c4d162f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:14.627281 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-008f47ef-0540-4833-99df-559d2c4d162f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:14.636489 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b9288b7d-5182-4986-b52a-9743c1a014bb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-677207848" status: 202 len: 0 microversion: 2.1 time: 0.129987 Jul 18 10:51:14.637470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 240/512] 10.222.0.49 () {58 vars in 1217 bytes} [Mon Jul 18 10:51:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-677207848 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:51:14.797367 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-008f47ef-0540-4833-99df-559d2c4d162f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:14.808147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-008f47ef-0540-4833-99df-559d2c4d162f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1260 microversion: 2.1 time: 0.194362 Jul 18 10:51:14.811768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 273/513] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:14 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:15.133597 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-ba8ce3f4-a230-4323-bd51-8236cb558eb9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:15.134167 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-ba8ce3f4-a230-4323-bd51-8236cb558eb9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:15.141357 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ba8ce3f4-a230-4323-bd51-8236cb558eb9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:15.142053 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ba8ce3f4-a230-4323-bd51-8236cb558eb9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:15.143552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ba8ce3f4-a230-4323-bd51-8236cb558eb9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:15.144168 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ba8ce3f4-a230-4323-bd51-8236cb558eb9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:15.343796 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ba8ce3f4-a230-4323-bd51-8236cb558eb9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:15.352236 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-ba8ce3f4-a230-4323-bd51-8236cb558eb9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.223073 Jul 18 10:51:15.352830 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 241/514] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:15 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:15.642710 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-dfa302c3-7c15-42ab-af2f-ef0252ff139b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Action: 'create', calling method: .version_select at 0x7f6364b875e0>, body: {"keypair": {"name": "tempest-keypair-190798423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGhe10rIqfINQDtqkJxGY/ts/XkBSO7i5yO9iKLgMMwzY/rgOyHjHsGGhzg3RwIhT9HhPjTIf79919a2YyGZYrMGb4rd5defzlyNSCFcFBzxgD+4bYGIZEsAxNp3F093g=="}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:15.657848 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-dfa302c3-7c15-42ab-af2f-ef0252ff139b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'key_pairs'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:51:15.661820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-dfa302c3-7c15-42ab-af2f-ef0252ff139b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for user 3954fd4abf6b4c3a82280c762292a3e7 and project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'key_pairs'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:51:15.773912 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-dfa302c3-7c15-42ab-af2f-ef0252ff139b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135141 Jul 18 10:51:15.774540 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 274/515] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 18 10:51:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:15.825756 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-785ab2a3-eba7-4eec-aeb6-39543ac34e3b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:15.826366 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-785ab2a3-eba7-4eec-aeb6-39543ac34e3b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:15.833137 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-785ab2a3-eba7-4eec-aeb6-39543ac34e3b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:15.833587 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-785ab2a3-eba7-4eec-aeb6-39543ac34e3b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:15.834351 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-785ab2a3-eba7-4eec-aeb6-39543ac34e3b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:15.834832 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-785ab2a3-eba7-4eec-aeb6-39543ac34e3b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:16.008953 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-785ab2a3-eba7-4eec-aeb6-39543ac34e3b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:16.017795 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-785ab2a3-eba7-4eec-aeb6-39543ac34e3b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1260 microversion: 2.1 time: 0.196119 Jul 18 10:51:16.018390 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 242/516] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:15 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:16.248912 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-31aaef6d-a73e-48b9-a198-d0d3aff7a1b9 req-b6068500-4fdb-4de3-a9a2-a3be38467569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dab0fce-91d6-4e37-970c-02ba8250d354", "name": "network-vif-plugged", "status": "completed", "tag": "251fff9b-71a7-49e1-bd58-5b46a671f255"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:16.257500 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-31aaef6d-a73e-48b9-a198-d0d3aff7a1b9 req-b6068500-4fdb-4de3-a9a2-a3be38467569 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:16.258808 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-31aaef6d-a73e-48b9-a198-d0d3aff7a1b9 req-b6068500-4fdb-4de3-a9a2-a3be38467569 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:16.270163 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-31aaef6d-a73e-48b9-a198-d0d3aff7a1b9 req-b6068500-4fdb-4de3-a9a2-a3be38467569 service nova] Creating event network-vif-plugged:251fff9b-71a7-49e1-bd58-5b46a671f255 for instance 3dab0fce-91d6-4e37-970c-02ba8250d354 on hv-cinder-84949 Jul 18 10:51:16.275232 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-31aaef6d-a73e-48b9-a198-d0d3aff7a1b9 req-b6068500-4fdb-4de3-a9a2-a3be38467569 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030431 Jul 18 10:51:16.275891 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 275/517] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:16.369859 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8ec5069f-6870-4f86-aaca-2e10ece805a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:16.370654 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8ec5069f-6870-4f86-aaca-2e10ece805a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:16.376997 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8ec5069f-6870-4f86-aaca-2e10ece805a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:16.377451 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8ec5069f-6870-4f86-aaca-2e10ece805a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:16.378218 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8ec5069f-6870-4f86-aaca-2e10ece805a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:16.378677 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8ec5069f-6870-4f86-aaca-2e10ece805a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:16.572181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8ec5069f-6870-4f86-aaca-2e10ece805a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:16.580720 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8ec5069f-6870-4f86-aaca-2e10ece805a9 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.213885 Jul 18 10:51:16.580720 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 243/518] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:16 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:17.036736 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-145e9ab0-d826-4c5f-a67f-00345299c22c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:17.037444 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-145e9ab0-d826-4c5f-a67f-00345299c22c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:17.044020 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-145e9ab0-d826-4c5f-a67f-00345299c22c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:17.044477 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-145e9ab0-d826-4c5f-a67f-00345299c22c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:17.045311 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-145e9ab0-d826-4c5f-a67f-00345299c22c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:17.045754 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-145e9ab0-d826-4c5f-a67f-00345299c22c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:17.198007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-145e9ab0-d826-4c5f-a67f-00345299c22c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:17.205687 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-145e9ab0-d826-4c5f-a67f-00345299c22c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1260 microversion: 2.1 time: 0.173724 Jul 18 10:51:17.206248 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 276/519] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:17 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:17.599953 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-82968646-4b61-42d2-bc64-8a786d675931 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:17.600644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-82968646-4b61-42d2-bc64-8a786d675931 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:17.609289 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-82968646-4b61-42d2-bc64-8a786d675931 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:17.609847 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-82968646-4b61-42d2-bc64-8a786d675931 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:17.610616 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-82968646-4b61-42d2-bc64-8a786d675931 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:17.611070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-82968646-4b61-42d2-bc64-8a786d675931 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:17.773157 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-82968646-4b61-42d2-bc64-8a786d675931 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:17.782195 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-82968646-4b61-42d2-bc64-8a786d675931 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.186846 Jul 18 10:51:17.782722 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 244/520] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:17 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:18.222719 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-7ad3b435-b8b9-49f3-accf-2dcba03e1a98 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:18.223594 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-7ad3b435-b8b9-49f3-accf-2dcba03e1a98 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:18.230635 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ad3b435-b8b9-49f3-accf-2dcba03e1a98 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:18.231124 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ad3b435-b8b9-49f3-accf-2dcba03e1a98 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:18.231899 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ad3b435-b8b9-49f3-accf-2dcba03e1a98 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:18.232412 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ad3b435-b8b9-49f3-accf-2dcba03e1a98 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:18.711434 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7ad3b435-b8b9-49f3-accf-2dcba03e1a98 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:18.720399 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-7ad3b435-b8b9-49f3-accf-2dcba03e1a98 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1260 microversion: 2.1 time: 0.501991 Jul 18 10:51:18.721037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 277/521] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:18 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1260 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:18.799516 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6fb302f4-5691-406f-af72-005ed890a98b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:18.800129 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-6fb302f4-5691-406f-af72-005ed890a98b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:18.806995 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6fb302f4-5691-406f-af72-005ed890a98b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:18.807632 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6fb302f4-5691-406f-af72-005ed890a98b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:18.809062 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6fb302f4-5691-406f-af72-005ed890a98b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:18.809535 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6fb302f4-5691-406f-af72-005ed890a98b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:18.931377 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1584671121", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfde60e0-9a8e-4b4d-8a28-cc720005757b"}], "security_groups": [{"name": "tempest-securitygroup--1557330574"}], "key_name": "tempest-keypair-190798423", "user_data": "}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:18.950536 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6fb302f4-5691-406f-af72-005ed890a98b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:18.959570 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-6fb302f4-5691-406f-af72-005ed890a98b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.164043 Jul 18 10:51:18.960300 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 245/522] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:18 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:19.037880 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.network.neutron [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] validate_networks() for [('cfde60e0-9a8e-4b4d-8a28-cc720005757b', None, None, None, None, None)] {{(pid=125007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:51:19.431854 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Flavor limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:51:19.431854 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Image limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:51:19.431854 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Flavor pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:51:19.431854 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Image pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:51:19.431854 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:51:19.440533 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:19.441008 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:19.441807 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:19.442236 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:19.460655 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:51:19.465613 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for user 3954fd4abf6b4c3a82280c762292a3e7 and project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:51:19.477150 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Going to run 1 instances... {{(pid=125007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:51:19.479477 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:51:19.736593 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-477c9acc-bc19-4149-979d-fe506343ffce tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:19.742379 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-477c9acc-bc19-4149-979d-fe506343ffce tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:19.744038 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-477c9acc-bc19-4149-979d-fe506343ffce tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:19.744474 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-477c9acc-bc19-4149-979d-fe506343ffce tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:19.745830 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-477c9acc-bc19-4149-979d-fe506343ffce tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:19.747050 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-477c9acc-bc19-4149-979d-fe506343ffce tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:19.889086 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-477c9acc-bc19-4149-979d-fe506343ffce tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:19.895634 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-32d17bd8-668c-4431-9ada-4a62e14e620f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.969265 Jul 18 10:51:19.896600 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 278/523] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:51:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 10:51:19.897887 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-477c9acc-bc19-4149-979d-fe506343ffce tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1444 microversion: 2.1 time: 0.165135 Jul 18 10:51:19.898448 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 246/524] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:19 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:19.907909 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-76c76ebf-dd0f-4044-9857-ec7f659c8862 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:19.908665 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-76c76ebf-dd0f-4044-9857-ec7f659c8862 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:19.915270 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7fc046fb-fac9-43be-82f9-593184f09d76 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:19.915881 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-7fc046fb-fac9-43be-82f9-593184f09d76 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:19.918923 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:19.923205 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7fc046fb-fac9-43be-82f9-593184f09d76 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:19.923878 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7fc046fb-fac9-43be-82f9-593184f09d76 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:19.924981 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7fc046fb-fac9-43be-82f9-593184f09d76 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:19.925798 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7fc046fb-fac9-43be-82f9-593184f09d76 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:19.967276 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-76c76ebf-dd0f-4044-9857-ec7f659c8862 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:19.975981 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-76c76ebf-dd0f-4044-9857-ec7f659c8862 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1241 microversion: 2.1 time: 0.072164 Jul 18 10:51:19.976582 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 279/525] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:19 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:19.981988 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b6897f17-8092-4f82-acb2-2533370cee4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:19.982587 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b6897f17-8092-4f82-acb2-2533370cee4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:19.990006 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b6897f17-8092-4f82-acb2-2533370cee4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:19.990823 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b6897f17-8092-4f82-acb2-2533370cee4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:19.991781 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b6897f17-8092-4f82-acb2-2533370cee4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:19.992376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b6897f17-8092-4f82-acb2-2533370cee4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:20.155276 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7fc046fb-fac9-43be-82f9-593184f09d76 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:20.162550 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7fc046fb-fac9-43be-82f9-593184f09d76 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1444 microversion: 2.1 time: 0.251422 Jul 18 10:51:20.163130 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 247/526] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:19 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1444 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:20.186734 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b6897f17-8092-4f82-acb2-2533370cee4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:20.196201 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b6897f17-8092-4f82-acb2-2533370cee4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.218364 Jul 18 10:51:20.201255 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 280/527] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:19 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:20.993819 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bf3ca32e-ef5f-4313-affc-a094a543a428 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:20.994460 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-bf3ca32e-ef5f-4313-affc-a094a543a428 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:21.054287 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bf3ca32e-ef5f-4313-affc-a094a543a428 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:21.061413 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-bf3ca32e-ef5f-4313-affc-a094a543a428 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1241 microversion: 2.1 time: 0.071522 Jul 18 10:51:21.061994 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 248/528] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:20 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:21.219299 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-34e45654-6976-40ee-8aff-d25577e505a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:21.220036 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-34e45654-6976-40ee-8aff-d25577e505a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:21.229164 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-34e45654-6976-40ee-8aff-d25577e505a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:21.229832 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-34e45654-6976-40ee-8aff-d25577e505a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:21.230618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-34e45654-6976-40ee-8aff-d25577e505a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:21.231566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-34e45654-6976-40ee-8aff-d25577e505a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:21.249011 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:21.391355 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-34e45654-6976-40ee-8aff-d25577e505a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:21.400304 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-34e45654-6976-40ee-8aff-d25577e505a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.186731 Jul 18 10:51:21.400900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 281/529] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:21 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:22.079666 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6719588a-4e27-4e91-b13c-6d7b008cdb40 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:22.080460 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-6719588a-4e27-4e91-b13c-6d7b008cdb40 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:22.089395 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6719588a-4e27-4e91-b13c-6d7b008cdb40 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:22.089395 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6719588a-4e27-4e91-b13c-6d7b008cdb40 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:22.090811 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6719588a-4e27-4e91-b13c-6d7b008cdb40 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:22.091326 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6719588a-4e27-4e91-b13c-6d7b008cdb40 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:22.169171 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6719588a-4e27-4e91-b13c-6d7b008cdb40 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:22.175562 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-6719588a-4e27-4e91-b13c-6d7b008cdb40 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1293 microversion: 2.1 time: 0.100079 Jul 18 10:51:22.176442 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 249/530] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:22 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1293 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:22.418784 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a0523f89-1b47-4770-bc45-b9d1c330c427 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:22.419408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a0523f89-1b47-4770-bc45-b9d1c330c427 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:22.426940 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0523f89-1b47-4770-bc45-b9d1c330c427 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:22.427388 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0523f89-1b47-4770-bc45-b9d1c330c427 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:22.444248 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0523f89-1b47-4770-bc45-b9d1c330c427 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:22.444248 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0523f89-1b47-4770-bc45-b9d1c330c427 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:22.583769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a0523f89-1b47-4770-bc45-b9d1c330c427 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:22.592712 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a0523f89-1b47-4770-bc45-b9d1c330c427 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.178514 Jul 18 10:51:22.593683 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 282/531] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:22 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:22.866192 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-dd3054a9-ed0a-4984-a3be-a6ef83cf1471 req-55646df3-0bb6-458c-813b-3c3d66a8b7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dab0fce-91d6-4e37-970c-02ba8250d354", "tag": "251fff9b-71a7-49e1-bd58-5b46a671f255"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:22.875417 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-dd3054a9-ed0a-4984-a3be-a6ef83cf1471 req-55646df3-0bb6-458c-813b-3c3d66a8b7d2 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:22.880586 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-dd3054a9-ed0a-4984-a3be-a6ef83cf1471 req-55646df3-0bb6-458c-813b-3c3d66a8b7d2 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:22.888509 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-dd3054a9-ed0a-4984-a3be-a6ef83cf1471 req-55646df3-0bb6-458c-813b-3c3d66a8b7d2 service nova] Creating event network-changed:251fff9b-71a7-49e1-bd58-5b46a671f255 for instance 3dab0fce-91d6-4e37-970c-02ba8250d354 on hv-cinder-84949 Jul 18 10:51:22.893721 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-dd3054a9-ed0a-4984-a3be-a6ef83cf1471 req-55646df3-0bb6-458c-813b-3c3d66a8b7d2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031123 Jul 18 10:51:22.894385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 250/532] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:23.196190 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e97cca44-754b-4c6b-99db-d41519237d85 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:23.196882 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-e97cca44-754b-4c6b-99db-d41519237d85 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:23.209429 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e97cca44-754b-4c6b-99db-d41519237d85 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:23.209900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e97cca44-754b-4c6b-99db-d41519237d85 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:23.210695 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e97cca44-754b-4c6b-99db-d41519237d85 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:23.211134 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e97cca44-754b-4c6b-99db-d41519237d85 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:23.323885 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e97cca44-754b-4c6b-99db-d41519237d85 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:23.335869 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e97cca44-754b-4c6b-99db-d41519237d85 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1311 microversion: 2.1 time: 0.143427 Jul 18 10:51:23.348929 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 283/533] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:23 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1311 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:23.622378 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2bbc5e61-5d8d-43b8-bb50-ee5964b13d80 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:23.623078 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2bbc5e61-5d8d-43b8-bb50-ee5964b13d80 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:23.640636 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2bbc5e61-5d8d-43b8-bb50-ee5964b13d80 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:23.645881 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2bbc5e61-5d8d-43b8-bb50-ee5964b13d80 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:23.646835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2bbc5e61-5d8d-43b8-bb50-ee5964b13d80 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:23.647287 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2bbc5e61-5d8d-43b8-bb50-ee5964b13d80 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:23.921361 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-2bbc5e61-5d8d-43b8-bb50-ee5964b13d80 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:23.934479 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2bbc5e61-5d8d-43b8-bb50-ee5964b13d80 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.318187 Jul 18 10:51:23.934479 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 251/534] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:23 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:24.356216 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2c0ed335-5cdf-4f95-8b11-2711e6a473e8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:24.356762 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2c0ed335-5cdf-4f95-8b11-2711e6a473e8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:24.363890 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2c0ed335-5cdf-4f95-8b11-2711e6a473e8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:24.364329 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2c0ed335-5cdf-4f95-8b11-2711e6a473e8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:24.365123 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2c0ed335-5cdf-4f95-8b11-2711e6a473e8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:24.365560 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2c0ed335-5cdf-4f95-8b11-2711e6a473e8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:24.517222 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2c0ed335-5cdf-4f95-8b11-2711e6a473e8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:24.523435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2c0ed335-5cdf-4f95-8b11-2711e6a473e8 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1367 microversion: 2.1 time: 0.171747 Jul 18 10:51:24.524057 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 284/535] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:24 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:24.950423 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-36aab72a-e2a6-4eae-b528-03616364ccb5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:24.951893 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-36aab72a-e2a6-4eae-b528-03616364ccb5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:24.964373 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-36aab72a-e2a6-4eae-b528-03616364ccb5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:24.964373 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-36aab72a-e2a6-4eae-b528-03616364ccb5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:24.964373 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-36aab72a-e2a6-4eae-b528-03616364ccb5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:24.964373 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-36aab72a-e2a6-4eae-b528-03616364ccb5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:25.187139 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-36aab72a-e2a6-4eae-b528-03616364ccb5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:25.203127 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-36aab72a-e2a6-4eae-b528-03616364ccb5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.256364 Jul 18 10:51:25.215014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 252/536] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:24 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:25.475191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-ae854f98-5b5d-4acd-adea-39e4ef4f092f req-0746d349-9ed9-4a09-ba97-2a90edc7f4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924", "tag": "e30195bc-be76-4526-8e2b-0e9910a4d0ce"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:25.487207 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-ae854f98-5b5d-4acd-adea-39e4ef4f092f req-0746d349-9ed9-4a09-ba97-2a90edc7f4b7 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:25.491997 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-ae854f98-5b5d-4acd-adea-39e4ef4f092f req-0746d349-9ed9-4a09-ba97-2a90edc7f4b7 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:25.502129 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-ae854f98-5b5d-4acd-adea-39e4ef4f092f req-0746d349-9ed9-4a09-ba97-2a90edc7f4b7 service nova] Creating event network-changed:e30195bc-be76-4526-8e2b-0e9910a4d0ce for instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 on hv-cinder-84949 Jul 18 10:51:25.509356 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-ae854f98-5b5d-4acd-adea-39e4ef4f092f req-0746d349-9ed9-4a09-ba97-2a90edc7f4b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037731 Jul 18 10:51:25.510435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 285/537] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:25.541164 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-903c7da4-7afd-4738-a47e-d4fb6103b26b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:25.543245 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-903c7da4-7afd-4738-a47e-d4fb6103b26b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:25.554313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-903c7da4-7afd-4738-a47e-d4fb6103b26b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:25.554759 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-903c7da4-7afd-4738-a47e-d4fb6103b26b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:25.555538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-903c7da4-7afd-4738-a47e-d4fb6103b26b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:25.555964 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-903c7da4-7afd-4738-a47e-d4fb6103b26b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:25.787477 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-903c7da4-7afd-4738-a47e-d4fb6103b26b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:25.796200 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-903c7da4-7afd-4738-a47e-d4fb6103b26b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1367 microversion: 2.1 time: 0.259088 Jul 18 10:51:25.797075 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 253/538] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:25 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:26.231991 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3fbd9bc3-45a8-4f1b-a067-c8548725cf2a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:26.232878 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3fbd9bc3-45a8-4f1b-a067-c8548725cf2a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:26.241169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3fbd9bc3-45a8-4f1b-a067-c8548725cf2a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:26.241512 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3fbd9bc3-45a8-4f1b-a067-c8548725cf2a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:26.242298 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3fbd9bc3-45a8-4f1b-a067-c8548725cf2a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:26.242762 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3fbd9bc3-45a8-4f1b-a067-c8548725cf2a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:26.436758 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3fbd9bc3-45a8-4f1b-a067-c8548725cf2a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:26.445032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3fbd9bc3-45a8-4f1b-a067-c8548725cf2a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.218293 Jul 18 10:51:26.445598 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 286/539] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:26 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:26.814079 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7a20c66f-87e4-4f18-8c1e-6b22b3ef82d3 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:26.816020 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-7a20c66f-87e4-4f18-8c1e-6b22b3ef82d3 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:26.821445 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7a20c66f-87e4-4f18-8c1e-6b22b3ef82d3 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:26.821888 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7a20c66f-87e4-4f18-8c1e-6b22b3ef82d3 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:26.822651 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7a20c66f-87e4-4f18-8c1e-6b22b3ef82d3 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:26.823233 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7a20c66f-87e4-4f18-8c1e-6b22b3ef82d3 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:26.970748 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7a20c66f-87e4-4f18-8c1e-6b22b3ef82d3 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:26.979827 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7a20c66f-87e4-4f18-8c1e-6b22b3ef82d3 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1367 microversion: 2.1 time: 0.169014 Jul 18 10:51:26.980389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 254/540] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:26 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:27.464271 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-99b451e9-decb-45c3-bbe6-025e3d5ee754 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:27.466367 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-99b451e9-decb-45c3-bbe6-025e3d5ee754 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:27.474410 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-99b451e9-decb-45c3-bbe6-025e3d5ee754 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:27.474862 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-99b451e9-decb-45c3-bbe6-025e3d5ee754 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:27.475637 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-99b451e9-decb-45c3-bbe6-025e3d5ee754 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:27.476083 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-99b451e9-decb-45c3-bbe6-025e3d5ee754 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:27.615027 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-99b451e9-decb-45c3-bbe6-025e3d5ee754 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:27.624245 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-99b451e9-decb-45c3-bbe6-025e3d5ee754 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.164348 Jul 18 10:51:27.624869 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 287/541] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:27 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:27.997304 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-ef8d6e2e-ecce-42ef-b3c9-145cd2d7fb9a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:27.997951 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-ef8d6e2e-ecce-42ef-b3c9-145cd2d7fb9a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:28.005900 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ef8d6e2e-ecce-42ef-b3c9-145cd2d7fb9a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:28.006342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ef8d6e2e-ecce-42ef-b3c9-145cd2d7fb9a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:28.007116 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ef8d6e2e-ecce-42ef-b3c9-145cd2d7fb9a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:28.007541 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ef8d6e2e-ecce-42ef-b3c9-145cd2d7fb9a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:28.188237 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ef8d6e2e-ecce-42ef-b3c9-145cd2d7fb9a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:28.195921 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-ef8d6e2e-ecce-42ef-b3c9-145cd2d7fb9a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1367 microversion: 2.1 time: 0.202887 Jul 18 10:51:28.196501 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 255/542] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:27 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:28.642905 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4435f0f3-bbb4-49c8-9824-f44a1ef7a4b0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:28.643429 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-4435f0f3-bbb4-49c8-9824-f44a1ef7a4b0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:28.645972 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:28.650901 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4435f0f3-bbb4-49c8-9824-f44a1ef7a4b0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:28.651953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4435f0f3-bbb4-49c8-9824-f44a1ef7a4b0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:28.652840 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4435f0f3-bbb4-49c8-9824-f44a1ef7a4b0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:28.653280 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4435f0f3-bbb4-49c8-9824-f44a1ef7a4b0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:28.791730 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-4435f0f3-bbb4-49c8-9824-f44a1ef7a4b0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:28.801075 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4435f0f3-bbb4-49c8-9824-f44a1ef7a4b0 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.162422 Jul 18 10:51:28.801792 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 288/543] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:28 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:29.212332 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3d99254d-bb43-4a05-b456-764bc328ead4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:29.212965 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3d99254d-bb43-4a05-b456-764bc328ead4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:29.220983 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3d99254d-bb43-4a05-b456-764bc328ead4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:29.221435 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3d99254d-bb43-4a05-b456-764bc328ead4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:29.222203 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3d99254d-bb43-4a05-b456-764bc328ead4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:29.222658 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3d99254d-bb43-4a05-b456-764bc328ead4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:29.373916 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3d99254d-bb43-4a05-b456-764bc328ead4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:29.382057 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3d99254d-bb43-4a05-b456-764bc328ead4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1367 microversion: 2.1 time: 0.173616 Jul 18 10:51:29.382405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 256/544] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:29 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:29.819692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-71ef6b21-737d-4cd3-b4ee-2493f80e6c64 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:29.820382 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-71ef6b21-737d-4cd3-b4ee-2493f80e6c64 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:29.822302 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=2 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:29.828682 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-71ef6b21-737d-4cd3-b4ee-2493f80e6c64 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:29.829162 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-71ef6b21-737d-4cd3-b4ee-2493f80e6c64 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:29.829940 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-71ef6b21-737d-4cd3-b4ee-2493f80e6c64 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:29.830373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-71ef6b21-737d-4cd3-b4ee-2493f80e6c64 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:29.972751 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=12 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:29.986545 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-71ef6b21-737d-4cd3-b4ee-2493f80e6c64 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:29.995221 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-71ef6b21-737d-4cd3-b4ee-2493f80e6c64 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.179617 Jul 18 10:51:29.996523 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 289/545] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:29 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:30.402024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-0cb64915-05b0-42d5-b2d0-22c6a9284c23 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:30.402647 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-0cb64915-05b0-42d5-b2d0-22c6a9284c23 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:30.409658 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0cb64915-05b0-42d5-b2d0-22c6a9284c23 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:30.410102 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0cb64915-05b0-42d5-b2d0-22c6a9284c23 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:30.410938 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0cb64915-05b0-42d5-b2d0-22c6a9284c23 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:30.411301 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0cb64915-05b0-42d5-b2d0-22c6a9284c23 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:30.563161 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0cb64915-05b0-42d5-b2d0-22c6a9284c23 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:30.570969 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-0cb64915-05b0-42d5-b2d0-22c6a9284c23 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1367 microversion: 2.1 time: 0.173069 Jul 18 10:51:30.571596 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 257/546] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:30 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:31.014099 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-05f299e6-45db-48ac-a4f4-6c914a075327 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:31.014896 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-05f299e6-45db-48ac-a4f4-6c914a075327 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:31.022376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-05f299e6-45db-48ac-a4f4-6c914a075327 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:31.022739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-05f299e6-45db-48ac-a4f4-6c914a075327 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:31.023508 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-05f299e6-45db-48ac-a4f4-6c914a075327 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:31.023938 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-05f299e6-45db-48ac-a4f4-6c914a075327 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:31.216565 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-05f299e6-45db-48ac-a4f4-6c914a075327 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:31.225581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-05f299e6-45db-48ac-a4f4-6c914a075327 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.216115 Jul 18 10:51:31.226341 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 290/547] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:31 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:31.590357 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b514a6d9-9cb0-4bf0-bf3d-1015b120d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:31.590957 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b514a6d9-9cb0-4bf0-bf3d-1015b120d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:31.593275 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=2 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:31.598658 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b514a6d9-9cb0-4bf0-bf3d-1015b120d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:31.599098 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b514a6d9-9cb0-4bf0-bf3d-1015b120d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:31.599849 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b514a6d9-9cb0-4bf0-bf3d-1015b120d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:31.600278 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b514a6d9-9cb0-4bf0-bf3d-1015b120d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:31.604352 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=100 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:31.735778 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-b514a6d9-9cb0-4bf0-bf3d-1015b120d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:31.743342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b514a6d9-9cb0-4bf0-bf3d-1015b120d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1367 microversion: 2.1 time: 0.157724 Jul 18 10:51:31.743918 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 258/548] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:31 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:32.249359 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9bd2c780-6ad1-4476-9158-a54227c47495 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:32.250032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9bd2c780-6ad1-4476-9158-a54227c47495 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:32.256814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9bd2c780-6ad1-4476-9158-a54227c47495 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:32.257264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9bd2c780-6ad1-4476-9158-a54227c47495 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:32.258040 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9bd2c780-6ad1-4476-9158-a54227c47495 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:32.258507 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9bd2c780-6ad1-4476-9158-a54227c47495 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:32.272077 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-fc32eaf5-af2b-4da8-ae76-e0e33dc9d54c req-3e7bc646-8eee-420d-be3f-834380375472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924", "name": "network-vif-plugged", "status": "completed", "tag": "e30195bc-be76-4526-8e2b-0e9910a4d0ce"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:32.282429 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-fc32eaf5-af2b-4da8-ae76-e0e33dc9d54c req-3e7bc646-8eee-420d-be3f-834380375472 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:32.282908 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-fc32eaf5-af2b-4da8-ae76-e0e33dc9d54c req-3e7bc646-8eee-420d-be3f-834380375472 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:32.295438 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-fc32eaf5-af2b-4da8-ae76-e0e33dc9d54c req-3e7bc646-8eee-420d-be3f-834380375472 service nova] Creating event network-vif-plugged:e30195bc-be76-4526-8e2b-0e9910a4d0ce for instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 on hv-cinder-84949 Jul 18 10:51:32.300765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-fc32eaf5-af2b-4da8-ae76-e0e33dc9d54c req-3e7bc646-8eee-420d-be3f-834380375472 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033637 Jul 18 10:51:32.303021 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 259/549] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:51:32.418887 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9bd2c780-6ad1-4476-9158-a54227c47495 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:32.429645 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9bd2c780-6ad1-4476-9158-a54227c47495 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.184889 Jul 18 10:51:32.430362 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 291/550] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:32 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:32.762834 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-ce44162c-e453-4ead-881b-76d0f1a8eecb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:32.763625 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-ce44162c-e453-4ead-881b-76d0f1a8eecb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:32.770107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ce44162c-e453-4ead-881b-76d0f1a8eecb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:32.770552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ce44162c-e453-4ead-881b-76d0f1a8eecb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:32.771322 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ce44162c-e453-4ead-881b-76d0f1a8eecb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:32.771758 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ce44162c-e453-4ead-881b-76d0f1a8eecb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:32.934288 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ce44162c-e453-4ead-881b-76d0f1a8eecb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:32.942918 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-ce44162c-e453-4ead-881b-76d0f1a8eecb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1367 microversion: 2.1 time: 0.184938 Jul 18 10:51:32.943512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 260/551] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:32 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:33.447621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a90cde98-9dd7-4879-ba18-78fe68a3a58f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:33.449041 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a90cde98-9dd7-4879-ba18-78fe68a3a58f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:33.455796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a90cde98-9dd7-4879-ba18-78fe68a3a58f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:33.461191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a90cde98-9dd7-4879-ba18-78fe68a3a58f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:33.461191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a90cde98-9dd7-4879-ba18-78fe68a3a58f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:33.461191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a90cde98-9dd7-4879-ba18-78fe68a3a58f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:33.598811 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a90cde98-9dd7-4879-ba18-78fe68a3a58f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:33.608694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a90cde98-9dd7-4879-ba18-78fe68a3a58f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.164778 Jul 18 10:51:33.609317 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 292/552] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:33 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:33.961873 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5c0cd6b1-f980-474b-b0f1-3457523a862e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:33.962607 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5c0cd6b1-f980-474b-b0f1-3457523a862e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:33.970591 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c0cd6b1-f980-474b-b0f1-3457523a862e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:33.971030 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c0cd6b1-f980-474b-b0f1-3457523a862e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:33.971798 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c0cd6b1-f980-474b-b0f1-3457523a862e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:33.972221 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c0cd6b1-f980-474b-b0f1-3457523a862e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:34.115298 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5c0cd6b1-f980-474b-b0f1-3457523a862e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:34.123560 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5c0cd6b1-f980-474b-b0f1-3457523a862e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1367 microversion: 2.1 time: 0.165511 Jul 18 10:51:34.124140 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 261/553] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:33 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:34.627711 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-75b3a8c0-0359-429b-a89d-d2c56710b67d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:34.628320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-75b3a8c0-0359-429b-a89d-d2c56710b67d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:34.635115 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-75b3a8c0-0359-429b-a89d-d2c56710b67d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:34.636082 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-75b3a8c0-0359-429b-a89d-d2c56710b67d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:34.637009 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-75b3a8c0-0359-429b-a89d-d2c56710b67d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:34.637451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-75b3a8c0-0359-429b-a89d-d2c56710b67d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:34.779746 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-75b3a8c0-0359-429b-a89d-d2c56710b67d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:34.788269 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-75b3a8c0-0359-429b-a89d-d2c56710b67d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.164466 Jul 18 10:51:34.788878 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 293/554] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:34 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:35.140917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-1e1b4d20-e9bf-4443-945c-4b4888562913 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:35.141636 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-1e1b4d20-e9bf-4443-945c-4b4888562913 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:35.148375 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1e1b4d20-e9bf-4443-945c-4b4888562913 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:35.148834 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1e1b4d20-e9bf-4443-945c-4b4888562913 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:35.149605 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1e1b4d20-e9bf-4443-945c-4b4888562913 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:35.150036 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1e1b4d20-e9bf-4443-945c-4b4888562913 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:35.294542 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-1e1b4d20-e9bf-4443-945c-4b4888562913 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:35.302169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-1e1b4d20-e9bf-4443-945c-4b4888562913 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1367 microversion: 2.1 time: 0.165173 Jul 18 10:51:35.302730 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 262/555] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:35 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:35.805969 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9e301b2c-0c83-4cce-a402-f04561a87079 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:35.806586 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9e301b2c-0c83-4cce-a402-f04561a87079 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:35.815864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e301b2c-0c83-4cce-a402-f04561a87079 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:35.827628 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e301b2c-0c83-4cce-a402-f04561a87079 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:35.827628 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e301b2c-0c83-4cce-a402-f04561a87079 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:35.827628 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e301b2c-0c83-4cce-a402-f04561a87079 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:35.994504 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9e301b2c-0c83-4cce-a402-f04561a87079 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:36.003785 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9e301b2c-0c83-4cce-a402-f04561a87079 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.201820 Jul 18 10:51:36.004382 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 294/556] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:35 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:36.321627 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5c9d93cf-2f9d-45ae-b31a-6fca256b4afd tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:36.322450 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5c9d93cf-2f9d-45ae-b31a-6fca256b4afd tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:36.329210 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c9d93cf-2f9d-45ae-b31a-6fca256b4afd tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:36.329657 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c9d93cf-2f9d-45ae-b31a-6fca256b4afd tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:36.330432 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c9d93cf-2f9d-45ae-b31a-6fca256b4afd tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:36.330864 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c9d93cf-2f9d-45ae-b31a-6fca256b4afd tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:36.475274 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5c9d93cf-2f9d-45ae-b31a-6fca256b4afd tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:36.495368 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5c9d93cf-2f9d-45ae-b31a-6fca256b4afd tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1557 microversion: 2.1 time: 0.165716 Jul 18 10:51:36.495368 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 263/557] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:36 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:36.500931 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ea02e140-fa54-427c-b548-8d83452ffb39 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:36.501459 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ea02e140-fa54-427c-b548-8d83452ffb39 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:36.508547 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ea02e140-fa54-427c-b548-8d83452ffb39 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:36.509033 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ea02e140-fa54-427c-b548-8d83452ffb39 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:36.509811 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ea02e140-fa54-427c-b548-8d83452ffb39 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:36.510959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ea02e140-fa54-427c-b548-8d83452ffb39 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:36.593572 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ea02e140-fa54-427c-b548-8d83452ffb39 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096722 Jul 18 10:51:36.594170 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 295/558] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 18 10:51:36 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:37.023308 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a20bf5a8-e8c1-493a-9ef3-2d2cf49313a4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:37.024249 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a20bf5a8-e8c1-493a-9ef3-2d2cf49313a4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:37.033566 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a20bf5a8-e8c1-493a-9ef3-2d2cf49313a4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:37.034065 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a20bf5a8-e8c1-493a-9ef3-2d2cf49313a4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:37.034847 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a20bf5a8-e8c1-493a-9ef3-2d2cf49313a4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:37.035278 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a20bf5a8-e8c1-493a-9ef3-2d2cf49313a4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:37.322398 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a20bf5a8-e8c1-493a-9ef3-2d2cf49313a4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:37.332360 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a20bf5a8-e8c1-493a-9ef3-2d2cf49313a4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1734 microversion: 2.1 time: 0.314564 Jul 18 10:51:37.332992 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 264/559] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:37 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1734 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:38.058597 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-d9191a27-865e-4dad-854d-d4af2b2cf1b5 req-e6efb16f-02ec-4971-94e2-700894703162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924", "tag": "e30195bc-be76-4526-8e2b-0e9910a4d0ce"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:38.066792 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-d9191a27-865e-4dad-854d-d4af2b2cf1b5 req-e6efb16f-02ec-4971-94e2-700894703162 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:38.067449 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-d9191a27-865e-4dad-854d-d4af2b2cf1b5 req-e6efb16f-02ec-4971-94e2-700894703162 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:38.081690 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-d9191a27-865e-4dad-854d-d4af2b2cf1b5 req-e6efb16f-02ec-4971-94e2-700894703162 service nova] Creating event network-changed:e30195bc-be76-4526-8e2b-0e9910a4d0ce for instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 on hv-cinder-84949 Jul 18 10:51:38.087670 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-d9191a27-865e-4dad-854d-d4af2b2cf1b5 req-e6efb16f-02ec-4971-94e2-700894703162 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034218 Jul 18 10:51:38.088996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 296/560] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:38.357193 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-14370da1-23d2-4818-917a-94e4d4f4e475 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:38.358507 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-14370da1-23d2-4818-917a-94e4d4f4e475 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:38.366562 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-14370da1-23d2-4818-917a-94e4d4f4e475 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:38.367017 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-14370da1-23d2-4818-917a-94e4d4f4e475 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:38.367827 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-14370da1-23d2-4818-917a-94e4d4f4e475 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:38.368263 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-14370da1-23d2-4818-917a-94e4d4f4e475 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:38.581477 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-14370da1-23d2-4818-917a-94e4d4f4e475 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:38.590625 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-14370da1-23d2-4818-917a-94e4d4f4e475 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1714 microversion: 2.1 time: 0.238821 Jul 18 10:51:38.591216 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 265/561] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:38 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1714 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:38.714673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ac6024f6-5fc6-4ec5-a549-7ec3ec69ff3a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:38.715259 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ac6024f6-5fc6-4ec5-a549-7ec3ec69ff3a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:38.722187 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ac6024f6-5fc6-4ec5-a549-7ec3ec69ff3a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:38.722953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ac6024f6-5fc6-4ec5-a549-7ec3ec69ff3a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:38.723770 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ac6024f6-5fc6-4ec5-a549-7ec3ec69ff3a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:38.724215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ac6024f6-5fc6-4ec5-a549-7ec3ec69ff3a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:38.816948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-ac6024f6-5fc6-4ec5-a549-7ec3ec69ff3a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] HTTP exception thrown: Cannot 'detach_volume' instance 48a4f543-a994-4897-8ced-5c04fed9ef50 while it is in vm_state rescued Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ac6024f6-5fc6-4ec5-a549-7ec3ec69ff3a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Request method failure captured: Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: DELETE /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments/a19cf8de-afb4-48ee-a3df-ec5e8c0cb8e6 HTTP/1.1 Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To0Hl7Z7tH4wrosljtOhuMMHcXL6pbeD1JuHCgjD-oe7va1swEl_8GoI03QFcODlczAxCQbyvU0gTRqpouGzPswCVdRlGstD4W0yiS7plk3qIPQYhozJnU_oV-MWNpSc406Kvd4flOyJY-_9P0GucpgDhdqM1T2S-0iE92Vf0JN-p8 Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 7184d0f3256344a2af18c639787e538f Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1177899909 Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:51:38.818566 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:51:38.820068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7184d0f3256344a2af18c639787e538f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7184d0f3256344a2af18c639787e538f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7184d0f3256344a2af18c639787e538f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7184d0f3256344a2af18c639787e538f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:51:38.820068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1177899909 Jul 18 10:51:38.820068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 7184d0f3256344a2af18c639787e538f Jul 18 10:51:38.820068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1177899909 Jul 18 10:51:38.820068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-ServerRescueNegativeTestJSON-1177899909-project Jul 18 10:51:38.820068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:51:38.820068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:51:38.820068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: e7a738986f87470681c6a578599a089f Jul 18 10:51:38.820068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1177899909-project Jul 18 10:51:38.820068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:51:38.820068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Cannot 'detach_volume' instance 48a4f543-a994-4897-8ced-5c04fed9ef50 while it is in vm_state rescued Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'server_id': '48a4f543-a994-4897-8ced-5c04fed9ef50', 'id': 'a19cf8de-afb4-48ee-a3df-ec5e8c0cb8e6'} Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 48a4f543-a994-4897-8ced-5c04fed9ef50 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:51:38.820726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 48a4f543-a994-4897-8ced-5c04fed9ef50 while it is in vm_state rescued Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 48a4f543-a994-4897-8ced-5c04fed9ef50 while it is in vm_state rescued Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:51:38.822032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ac6024f6-5fc6-4ec5-a549-7ec3ec69ff3a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Returning 409 to user: Cannot 'detach_volume' instance 48a4f543-a994-4897-8ced-5c04fed9ef50 while it is in vm_state rescued {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:51:38.823061 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ac6024f6-5fc6-4ec5-a549-7ec3ec69ff3a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "DELETE /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments/a19cf8de-afb4-48ee-a3df-ec5e8c0cb8e6" status: 409 len: 152 microversion: 2.1 time: 0.111757 Jul 18 10:51:38.823061 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 297/562] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 18 10:51:38 2022] DELETE /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments/a19cf8de-afb4-48ee-a3df-ec5e8c0cb8e6 => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 10:51:38.829477 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-734e1572-e277-4e53-9158-a7720bd58df7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:38.833139 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-734e1572-e277-4e53-9158-a7720bd58df7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:38.836944 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-734e1572-e277-4e53-9158-a7720bd58df7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:38.837551 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-734e1572-e277-4e53-9158-a7720bd58df7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:38.838737 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-734e1572-e277-4e53-9158-a7720bd58df7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:38.839367 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-734e1572-e277-4e53-9158-a7720bd58df7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:39.278587 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-734e1572-e277-4e53-9158-a7720bd58df7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "POST /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/action" status: 202 len: 0 microversion: 2.1 time: 0.452864 Jul 18 10:51:39.279373 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 266/563] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 18 10:51:38 2022] POST /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:51:39.289093 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0677dab1-7be6-4f24-82f4-1987b314a7bc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:39.289711 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-0677dab1-7be6-4f24-82f4-1987b314a7bc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:39.296684 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0677dab1-7be6-4f24-82f4-1987b314a7bc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:39.297164 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0677dab1-7be6-4f24-82f4-1987b314a7bc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:39.297937 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0677dab1-7be6-4f24-82f4-1987b314a7bc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:39.298398 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0677dab1-7be6-4f24-82f4-1987b314a7bc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:39.449980 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-0677dab1-7be6-4f24-82f4-1987b314a7bc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:39.459289 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-0677dab1-7be6-4f24-82f4-1987b314a7bc tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1722 microversion: 2.1 time: 0.175140 Jul 18 10:51:39.459884 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 298/564] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:39 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:40.484603 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-35ed7bcd-8a1b-4e35-8a34-c580ad595f2c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:40.485920 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-35ed7bcd-8a1b-4e35-8a34-c580ad595f2c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:40.493219 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-35ed7bcd-8a1b-4e35-8a34-c580ad595f2c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:40.493675 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-35ed7bcd-8a1b-4e35-8a34-c580ad595f2c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:40.494492 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-35ed7bcd-8a1b-4e35-8a34-c580ad595f2c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:40.495058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-35ed7bcd-8a1b-4e35-8a34-c580ad595f2c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:40.640771 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-35ed7bcd-8a1b-4e35-8a34-c580ad595f2c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:40.649300 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-35ed7bcd-8a1b-4e35-8a34-c580ad595f2c tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1722 microversion: 2.1 time: 0.174329 Jul 18 10:51:40.649867 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 267/565] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:40 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:41.667379 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-91f3803e-c677-4349-bddb-80749b520749 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:41.668048 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-91f3803e-c677-4349-bddb-80749b520749 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:41.676144 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-91f3803e-c677-4349-bddb-80749b520749 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:41.676673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-91f3803e-c677-4349-bddb-80749b520749 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:41.677458 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-91f3803e-c677-4349-bddb-80749b520749 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:41.677885 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-91f3803e-c677-4349-bddb-80749b520749 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:41.817167 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-91f3803e-c677-4349-bddb-80749b520749 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:41.819467 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=100 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:41.858529 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-91f3803e-c677-4349-bddb-80749b520749 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1722 microversion: 2.1 time: 0.164210 Jul 18 10:51:41.858529 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 299/566] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:41 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:42.846023 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bdd72b3a-dfe7-4738-bef0-c98dce00cc2f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:42.846628 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-bdd72b3a-dfe7-4738-bef0-c98dce00cc2f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:42.853008 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bdd72b3a-dfe7-4738-bef0-c98dce00cc2f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:42.853446 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bdd72b3a-dfe7-4738-bef0-c98dce00cc2f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:42.854336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bdd72b3a-dfe7-4738-bef0-c98dce00cc2f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:42.854888 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bdd72b3a-dfe7-4738-bef0-c98dce00cc2f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:42.996342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bdd72b3a-dfe7-4738-bef0-c98dce00cc2f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:43.004540 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-bdd72b3a-dfe7-4738-bef0-c98dce00cc2f tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1722 microversion: 2.1 time: 0.162763 Jul 18 10:51:43.005146 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 268/567] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:42 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:44.021547 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-7db776f4-fe36-4fbb-a322-2b9fae6b7a61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:44.022317 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-7db776f4-fe36-4fbb-a322-2b9fae6b7a61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:44.030222 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7db776f4-fe36-4fbb-a322-2b9fae6b7a61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:44.030666 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7db776f4-fe36-4fbb-a322-2b9fae6b7a61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:44.031441 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7db776f4-fe36-4fbb-a322-2b9fae6b7a61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:44.031874 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7db776f4-fe36-4fbb-a322-2b9fae6b7a61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:44.172561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7db776f4-fe36-4fbb-a322-2b9fae6b7a61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:44.180716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-7db776f4-fe36-4fbb-a322-2b9fae6b7a61 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1728 microversion: 2.1 time: 0.163101 Jul 18 10:51:44.181346 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 300/568] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:44 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:44.198015 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-328750d6-f4be-468a-a665-d5cdae4692b5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:44.199222 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-328750d6-f4be-468a-a665-d5cdae4692b5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:44.205333 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-328750d6-f4be-468a-a665-d5cdae4692b5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:44.205775 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-328750d6-f4be-468a-a665-d5cdae4692b5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:44.206556 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-328750d6-f4be-468a-a665-d5cdae4692b5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:44.206983 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-328750d6-f4be-468a-a665-d5cdae4692b5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:44.295147 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-328750d6-f4be-468a-a665-d5cdae4692b5 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101410 Jul 18 10:51:44.295747 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 269/569] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 18 10:51:44 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:45.546599 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-ef88cb16-aab4-4c8f-ad76-f8767fccac0f req-27cf083a-863f-4bb1-ac1d-34eec94b767b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a4f543-a994-4897-8ced-5c04fed9ef50", "tag": "3ac1975d-f8dd-432b-8748-aa525919c851"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:45.555610 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-ef88cb16-aab4-4c8f-ad76-f8767fccac0f req-27cf083a-863f-4bb1-ac1d-34eec94b767b service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:45.556221 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-ef88cb16-aab4-4c8f-ad76-f8767fccac0f req-27cf083a-863f-4bb1-ac1d-34eec94b767b service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:45.569826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-ef88cb16-aab4-4c8f-ad76-f8767fccac0f req-27cf083a-863f-4bb1-ac1d-34eec94b767b service nova] Creating event network-changed:3ac1975d-f8dd-432b-8748-aa525919c851 for instance 48a4f543-a994-4897-8ced-5c04fed9ef50 on hv-cinder-84949 Jul 18 10:51:45.575946 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-ef88cb16-aab4-4c8f-ad76-f8767fccac0f req-27cf083a-863f-4bb1-ac1d-34eec94b767b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032931 Jul 18 10:51:45.576939 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 301/570] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:47.332153 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-0375d222-3777-47bc-a3eb-f8198b7864dc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:47.333120 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-0375d222-3777-47bc-a3eb-f8198b7864dc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:47.339746 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0375d222-3777-47bc-a3eb-f8198b7864dc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:47.340200 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0375d222-3777-47bc-a3eb-f8198b7864dc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:47.340994 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0375d222-3777-47bc-a3eb-f8198b7864dc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:47.341427 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0375d222-3777-47bc-a3eb-f8198b7864dc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:47.370572 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-0375d222-3777-47bc-a3eb-f8198b7864dc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042833 Jul 18 10:51:47.371116 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 270/571] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:51:47 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:51:47.432346 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-18a736d7-e1ab-4473-b632-6a90b2700093 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:47.432955 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-18a736d7-e1ab-4473-b632-6a90b2700093 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:47.439490 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-18a736d7-e1ab-4473-b632-6a90b2700093 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:47.439942 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-18a736d7-e1ab-4473-b632-6a90b2700093 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:47.440710 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-18a736d7-e1ab-4473-b632-6a90b2700093 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:47.441182 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-18a736d7-e1ab-4473-b632-6a90b2700093 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:47.469569 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-18a736d7-e1ab-4473-b632-6a90b2700093 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Going to try to terminate instance {{(pid=125007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:51:47.594219 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-8c0d75d4-95b4-4ce1-bac9-cc3134d59c67 req-c3403971-a5a4-49de-b7c9-359db121f95c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a4f543-a994-4897-8ced-5c04fed9ef50", "tag": "3ac1975d-f8dd-432b-8748-aa525919c851"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:47.602340 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-8c0d75d4-95b4-4ce1-bac9-cc3134d59c67 req-c3403971-a5a4-49de-b7c9-359db121f95c service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:47.602800 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-8c0d75d4-95b4-4ce1-bac9-cc3134d59c67 req-c3403971-a5a4-49de-b7c9-359db121f95c service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:47.614529 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-8c0d75d4-95b4-4ce1-bac9-cc3134d59c67 req-c3403971-a5a4-49de-b7c9-359db121f95c service nova] Creating event network-changed:3ac1975d-f8dd-432b-8748-aa525919c851 for instance 48a4f543-a994-4897-8ced-5c04fed9ef50 on hv-cinder-84949 Jul 18 10:51:47.620964 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-8c0d75d4-95b4-4ce1-bac9-cc3134d59c67 req-c3403971-a5a4-49de-b7c9-359db121f95c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030293 Jul 18 10:51:47.621580 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 271/572] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:51:47.931728 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-18a736d7-e1ab-4473-b632-6a90b2700093 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 204 len: 0 microversion: 2.1 time: 0.503795 Jul 18 10:51:47.933127 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 302/573] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:51:47 2022] DELETE /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:51:47.942321 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-42a7a32e-c644-4595-8c27-9cdbd1dc6a38 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:47.943242 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-42a7a32e-c644-4595-8c27-9cdbd1dc6a38 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:47.950507 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-42a7a32e-c644-4595-8c27-9cdbd1dc6a38 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:47.956507 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-42a7a32e-c644-4595-8c27-9cdbd1dc6a38 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:47.956507 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-42a7a32e-c644-4595-8c27-9cdbd1dc6a38 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:47.956507 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-42a7a32e-c644-4595-8c27-9cdbd1dc6a38 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:48.095213 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-42a7a32e-c644-4595-8c27-9cdbd1dc6a38 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:48.102764 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-42a7a32e-c644-4595-8c27-9cdbd1dc6a38 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1674 microversion: 2.1 time: 0.165010 Jul 18 10:51:48.104093 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 272/574] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:47 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:49.122574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-bff716f2-672d-46b9-b373-da6bafa4e2ab tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:49.123167 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-bff716f2-672d-46b9-b373-da6bafa4e2ab tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:49.130633 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bff716f2-672d-46b9-b373-da6bafa4e2ab tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:49.131088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bff716f2-672d-46b9-b373-da6bafa4e2ab tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:49.131869 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bff716f2-672d-46b9-b373-da6bafa4e2ab tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:49.132308 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bff716f2-672d-46b9-b373-da6bafa4e2ab tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:49.268624 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-bff716f2-672d-46b9-b373-da6bafa4e2ab tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:49.277511 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-bff716f2-672d-46b9-b373-da6bafa4e2ab tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1674 microversion: 2.1 time: 0.159338 Jul 18 10:51:49.278094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 303/575] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:49 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:50.295791 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-915ba8c9-cc67-4327-a31f-3b951124b47d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:50.296329 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-915ba8c9-cc67-4327-a31f-3b951124b47d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:50.304258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-915ba8c9-cc67-4327-a31f-3b951124b47d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:50.304704 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-915ba8c9-cc67-4327-a31f-3b951124b47d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:50.305561 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-915ba8c9-cc67-4327-a31f-3b951124b47d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:50.306000 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-915ba8c9-cc67-4327-a31f-3b951124b47d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:50.552157 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-915ba8c9-cc67-4327-a31f-3b951124b47d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:50.560240 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-915ba8c9-cc67-4327-a31f-3b951124b47d tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1674 microversion: 2.1 time: 0.269083 Jul 18 10:51:50.560830 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 273/576] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:50 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1674 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:51.289038 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-fca4eb6b-4789-49ad-a913-d3c672619072 req-29089be9-cfcc-4dcd-8adb-7b64fa688050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f96ccdd-67b5-403c-a3b9-8022e271690c", "name": "network-vif-deleted", "tag": "820fb007-4789-49d7-84d1-ecf34d4d542f"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:51.298937 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-fca4eb6b-4789-49ad-a913-d3c672619072 req-29089be9-cfcc-4dcd-8adb-7b64fa688050 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:51.299385 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-fca4eb6b-4789-49ad-a913-d3c672619072 req-29089be9-cfcc-4dcd-8adb-7b64fa688050 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:51.311033 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-fca4eb6b-4789-49ad-a913-d3c672619072 req-29089be9-cfcc-4dcd-8adb-7b64fa688050 service nova] Creating event network-vif-deleted:820fb007-4789-49d7-84d1-ecf34d4d542f for instance 0f96ccdd-67b5-403c-a3b9-8022e271690c on hv-cinder-84949 Jul 18 10:51:51.316202 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-fca4eb6b-4789-49ad-a913-d3c672619072 req-29089be9-cfcc-4dcd-8adb-7b64fa688050 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030838 Jul 18 10:51:51.319885 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 304/577] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:51.577762 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-89ba7e44-8c59-456d-ad3c-ee26f61e4a34 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:51.578366 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-89ba7e44-8c59-456d-ad3c-ee26f61e4a34 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:51.585371 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89ba7e44-8c59-456d-ad3c-ee26f61e4a34 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:51.585781 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89ba7e44-8c59-456d-ad3c-ee26f61e4a34 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:51.586556 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89ba7e44-8c59-456d-ad3c-ee26f61e4a34 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:51.586976 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89ba7e44-8c59-456d-ad3c-ee26f61e4a34 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:51.659818 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-89ba7e44-8c59-456d-ad3c-ee26f61e4a34 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:51.669515 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-89ba7e44-8c59-456d-ad3c-ee26f61e4a34 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 200 len: 1323 microversion: 2.1 time: 0.096037 Jul 18 10:51:51.670114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 274/578] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:51 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 1323 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:52.690920 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6a766988-e7f4-4d91-ae8e-b55be76175e9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:52.691624 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6a766988-e7f4-4d91-ae8e-b55be76175e9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:52.699075 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6a766988-e7f4-4d91-ae8e-b55be76175e9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:52.699521 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6a766988-e7f4-4d91-ae8e-b55be76175e9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:52.700305 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6a766988-e7f4-4d91-ae8e-b55be76175e9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:52.700739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6a766988-e7f4-4d91-ae8e-b55be76175e9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:52.715997 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-6a766988-e7f4-4d91-ae8e-b55be76175e9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] HTTP exception thrown: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6a766988-e7f4-4d91-ae8e-b55be76175e9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Request method failure captured: Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c HTTP/1.1 Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To1mq42Ndp7G5x96udz53cuzwL6rrizGEn7J54kIiI6bCBpM4QEifJN_jwy6kTx_0fXUcSEJkSlsI-UlpNR0WtCjid5hxedN7cOliEvOxhjD294gI8VWpwLOKlkBv6m-Z7iZlLisxYQ1hzNN67IJH-BGYcXhQ90dkJTv-nSnjs9eSM Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: f32dc706424247d0ac1dc7a6aa633107 Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:51:52.717960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:51:52.719812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:51:52.719812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:51:52.719812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: f32dc706424247d0ac1dc7a6aa633107 Jul 18 10:51:52.719812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:51:52.719812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeTestJSON-528647951-project Jul 18 10:51:52.719812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:51:52.719812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:51:52.719812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 3dbb489073d94425ad1a1b350768c428 Jul 18 10:51:52.719812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeTestJSON-528647951-project Jul 18 10:51:52.719812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:51:52.719812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. Jul 18 10:51:52.719812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '0f96ccdd-67b5-403c-a3b9-8022e271690c'} Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:51:52.721110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. Jul 18 10:51:52.723142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:51:52.725391 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6a766988-e7f4-4d91-ae8e-b55be76175e9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Returning 404 to user: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:51:52.725391 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6a766988-e7f4-4d91-ae8e-b55be76175e9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 404 len: 111 microversion: 2.1 time: 0.033765 Jul 18 10:51:52.725391 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 305/579] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:52 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:51:52.729852 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8352d5f3-d766-4bc8-af4e-9c5e813cee7c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '.version_select at 0x7f6364dfdc10>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:52.736091 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=58 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:52.852747 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8352d5f3-d766-4bc8-af4e-9c5e813cee7c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574716326" status: 202 len: 0 microversion: 2.1 time: 0.127346 Jul 18 10:51:52.853425 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 275/580] 10.222.0.49 () {58 vars in 1220 bytes} [Mon Jul 18 10:51:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574716326 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:51:53.655418 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9eac5ba6-0294-490b-a4e2-a62ee3c7a832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:53.655902 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9eac5ba6-0294-490b-a4e2-a62ee3c7a832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:53.666852 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9eac5ba6-0294-490b-a4e2-a62ee3c7a832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:53.667604 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9eac5ba6-0294-490b-a4e2-a62ee3c7a832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:53.668477 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9eac5ba6-0294-490b-a4e2-a62ee3c7a832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:53.669024 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9eac5ba6-0294-490b-a4e2-a62ee3c7a832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:53.704638 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9eac5ba6-0294-490b-a4e2-a62ee3c7a832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/os-volume_attachments/0691165f-90e2-4267-902e-84850ba38df0" status: 200 len: 194 microversion: 2.20 time: 0.053361 Jul 18 10:51:53.705420 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 306/581] 10.222.0.49 () {60 vars in 1453 bytes} [Mon Jul 18 10:51:53 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/os-volume_attachments/0691165f-90e2-4267-902e-84850ba38df0 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:51:53.781263 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-0fc4a86a-5e6d-46e5-a30e-e5b1c61c7b9c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Action: 'create', calling method: .version_select at 0x7f6364ce0550>, body: {"keypair": {"name": "tempest-keypair-626116397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDK+0yqOBAPq7GCR5JyKhX1hsD5xW0UTJSfvJAM4nACfr1JMMqOq9CMOBTiT7ySFoIIVE/tGL7KkJXt3YPiJiV5O22jTd3gi4Z8XxyfjHNI5W1ENuquKQ9MP4RmGWE8Og=="}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:53.782789 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b2eb4b65-d5c9-4a30-ba77-03a26b63401c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:53.783287 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b2eb4b65-d5c9-4a30-ba77-03a26b63401c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:53.790468 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b2eb4b65-d5c9-4a30-ba77-03a26b63401c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:53.791140 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b2eb4b65-d5c9-4a30-ba77-03a26b63401c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:53.792317 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b2eb4b65-d5c9-4a30-ba77-03a26b63401c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:53.793009 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b2eb4b65-d5c9-4a30-ba77-03a26b63401c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:53.797013 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-0fc4a86a-5e6d-46e5-a30e-e5b1c61c7b9c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Getting quotas for project f32dc706424247d0ac1dc7a6aa633107. Resources: {'key_pairs'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:51:53.801594 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-0fc4a86a-5e6d-46e5-a30e-e5b1c61c7b9c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Getting quotas for user 3dbb489073d94425ad1a1b350768c428 and project f32dc706424247d0ac1dc7a6aa633107. Resources: {'key_pairs'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:51:53.898641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-b2eb4b65-d5c9-4a30-ba77-03a26b63401c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lazy-loading 'services' on Instance uuid 14d05192-b009-41ab-861b-b66d0352d41e {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:51:53.904387 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-0fc4a86a-5e6d-46e5-a30e-e5b1c61c7b9c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.130964 Jul 18 10:51:53.905018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 276/582] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 18 10:51:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:54.194072 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b2eb4b65-d5c9-4a30-ba77-03a26b63401c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "DELETE /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/os-volume_attachments/0691165f-90e2-4267-902e-84850ba38df0" status: 202 len: 0 microversion: 2.20 time: 0.415013 Jul 18 10:51:54.194726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 307/583] 10.222.0.49 () {60 vars in 1456 bytes} [Mon Jul 18 10:51:53 2022] DELETE /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/os-volume_attachments/0691165f-90e2-4267-902e-84850ba38df0 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 10:51:54.204402 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f03d3e79-e3bf-4482-9b53-c5dfb0104185 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:54.205963 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f03d3e79-e3bf-4482-9b53-c5dfb0104185 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:54.213907 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f03d3e79-e3bf-4482-9b53-c5dfb0104185 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:54.214412 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f03d3e79-e3bf-4482-9b53-c5dfb0104185 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:54.215316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f03d3e79-e3bf-4482-9b53-c5dfb0104185 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:54.215952 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f03d3e79-e3bf-4482-9b53-c5dfb0104185 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:54.233577 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:54.250997 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f03d3e79-e3bf-4482-9b53-c5dfb0104185 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051423 Jul 18 10:51:54.251790 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 277/584] 10.222.0.49 () {60 vars in 1342 bytes} [Mon Jul 18 10:51:54 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:51:55.271276 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ddfc6fab-a052-4c5f-9e9e-b28143a3bb23 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:55.271276 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ddfc6fab-a052-4c5f-9e9e-b28143a3bb23 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:55.279373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ddfc6fab-a052-4c5f-9e9e-b28143a3bb23 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:55.280028 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ddfc6fab-a052-4c5f-9e9e-b28143a3bb23 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:55.280897 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ddfc6fab-a052-4c5f-9e9e-b28143a3bb23 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:55.281398 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ddfc6fab-a052-4c5f-9e9e-b28143a3bb23 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:55.317459 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ddfc6fab-a052-4c5f-9e9e-b28143a3bb23 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055732 Jul 18 10:51:55.318046 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 308/585] 10.222.0.49 () {60 vars in 1342 bytes} [Mon Jul 18 10:51:55 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:51:56.329881 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-db717e02-5604-4ff2-b840-0b2197d5e4a6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:56.330793 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-db717e02-5604-4ff2-b840-0b2197d5e4a6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:56.338475 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-db717e02-5604-4ff2-b840-0b2197d5e4a6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:56.349592 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-db717e02-5604-4ff2-b840-0b2197d5e4a6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:56.349592 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-db717e02-5604-4ff2-b840-0b2197d5e4a6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:56.349592 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-db717e02-5604-4ff2-b840-0b2197d5e4a6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:56.371966 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-db717e02-5604-4ff2-b840-0b2197d5e4a6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046562 Jul 18 10:51:56.372538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 278/586] 10.222.0.49 () {60 vars in 1342 bytes} [Mon Jul 18 10:51:56 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:56.432430 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-698b669e-48c3-4e03-8f4f-506d20e0947c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:56.433019 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-698b669e-48c3-4e03-8f4f-506d20e0947c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:56.439604 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-698b669e-48c3-4e03-8f4f-506d20e0947c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:56.452619 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-698b669e-48c3-4e03-8f4f-506d20e0947c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:56.452619 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-698b669e-48c3-4e03-8f4f-506d20e0947c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:56.452619 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-698b669e-48c3-4e03-8f4f-506d20e0947c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:56.468755 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-698b669e-48c3-4e03-8f4f-506d20e0947c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Going to try to terminate instance {{(pid=125007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:51:56.944606 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-698b669e-48c3-4e03-8f4f-506d20e0947c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "DELETE /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 204 len: 0 microversion: 2.20 time: 0.515703 Jul 18 10:51:56.945276 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 309/587] 10.222.0.49 () {60 vars in 1279 bytes} [Mon Jul 18 10:51:56 2022] DELETE /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 10:51:56.954186 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3684c196-43da-4d5b-9ac9-cf9fbab27164 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:56.954845 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3684c196-43da-4d5b-9ac9-cf9fbab27164 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:56.961437 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3684c196-43da-4d5b-9ac9-cf9fbab27164 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:56.961947 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3684c196-43da-4d5b-9ac9-cf9fbab27164 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:56.962723 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3684c196-43da-4d5b-9ac9-cf9fbab27164 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:56.963150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3684c196-43da-4d5b-9ac9-cf9fbab27164 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:57.021507 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-446153844", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c1c65d9-29f8-4dd0-b3fd-1aaa05a8fb81"}], "security_groups": [{"name": "tempest-securitygroup--122222778"}], "key_name": "tempest-keypair-626116397", "user_data": "}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:57.114670 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3684c196-43da-4d5b-9ac9-cf9fbab27164 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:57.123441 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3684c196-43da-4d5b-9ac9-cf9fbab27164 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:57.124991 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3684c196-43da-4d5b-9ac9-cf9fbab27164 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:57.126154 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3684c196-43da-4d5b-9ac9-cf9fbab27164 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.176431 Jul 18 10:51:57.126713 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 279/588] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:51:56 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:51:57.141937 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.network.neutron [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] validate_networks() for [('2c1c65d9-29f8-4dd0-b3fd-1aaa05a8fb81', None, None, None, None, None)] {{(pid=125007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:51:57.534808 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Flavor limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:51:57.535422 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Image limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:51:57.535731 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Flavor pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:51:57.536146 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Image pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:51:57.536556 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:51:57.546111 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:57.546603 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:57.547408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:57.548031 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:57.565717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Getting quotas for project f32dc706424247d0ac1dc7a6aa633107. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:51:57.569841 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Getting quotas for user 3dbb489073d94425ad1a1b350768c428 and project f32dc706424247d0ac1dc7a6aa633107. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:51:57.582356 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Going to run 1 instances... {{(pid=125007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:51:57.584714 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:51:57.739669 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-8fcad455-03fb-4f3e-8da0-cc2bac1c29b4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.722837 Jul 18 10:51:57.740322 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 310/589] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:51:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 10:51:57.752171 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c3d7b348-9975-434e-8b0a-06e08787a5bd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:57.752798 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c3d7b348-9975-434e-8b0a-06e08787a5bd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:57.813081 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c3d7b348-9975-434e-8b0a-06e08787a5bd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:57.820156 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c3d7b348-9975-434e-8b0a-06e08787a5bd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1236 microversion: 2.1 time: 0.072818 Jul 18 10:51:57.820676 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 280/590] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:57 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:58.145737 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b469c648-8997-46e8-8f13-3cf67c2dfc9e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:58.146338 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b469c648-8997-46e8-8f13-3cf67c2dfc9e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:58.153248 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b469c648-8997-46e8-8f13-3cf67c2dfc9e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:58.153980 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b469c648-8997-46e8-8f13-3cf67c2dfc9e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:58.154479 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b469c648-8997-46e8-8f13-3cf67c2dfc9e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:58.154936 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b469c648-8997-46e8-8f13-3cf67c2dfc9e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:58.289013 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b469c648-8997-46e8-8f13-3cf67c2dfc9e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:58.298107 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b469c648-8997-46e8-8f13-3cf67c2dfc9e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:58.299781 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b469c648-8997-46e8-8f13-3cf67c2dfc9e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:58.305000 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b469c648-8997-46e8-8f13-3cf67c2dfc9e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.159208 Jul 18 10:51:58.305000 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 311/591] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:51:58 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:51:58.837806 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-93afd383-bd87-46e2-8e55-06ec53e0d928 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:58.838572 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-93afd383-bd87-46e2-8e55-06ec53e0d928 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:58.847073 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-93afd383-bd87-46e2-8e55-06ec53e0d928 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:58.847519 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-93afd383-bd87-46e2-8e55-06ec53e0d928 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:58.848345 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-93afd383-bd87-46e2-8e55-06ec53e0d928 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:58.848889 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-93afd383-bd87-46e2-8e55-06ec53e0d928 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:58.945110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-93afd383-bd87-46e2-8e55-06ec53e0d928 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:58.954172 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-93afd383-bd87-46e2-8e55-06ec53e0d928 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1240 microversion: 2.1 time: 0.120343 Jul 18 10:51:58.955053 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 281/592] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:58 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1240 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:59.320725 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-eafb6aa5-51f1-476b-bb06-2ea6de0b579b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:59.321333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-eafb6aa5-51f1-476b-bb06-2ea6de0b579b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:59.328592 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-eafb6aa5-51f1-476b-bb06-2ea6de0b579b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:59.329080 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-eafb6aa5-51f1-476b-bb06-2ea6de0b579b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:59.329877 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-eafb6aa5-51f1-476b-bb06-2ea6de0b579b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:59.330321 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-eafb6aa5-51f1-476b-bb06-2ea6de0b579b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:59.720489 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-eafb6aa5-51f1-476b-bb06-2ea6de0b579b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:59.729767 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-eafb6aa5-51f1-476b-bb06-2ea6de0b579b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:59.731526 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-eafb6aa5-51f1-476b-bb06-2ea6de0b579b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:59.732825 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-eafb6aa5-51f1-476b-bb06-2ea6de0b579b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1723 microversion: 2.20 time: 0.416499 Jul 18 10:51:59.733420 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 312/593] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:51:59 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1723 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:51:59.977313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e20081a3-ca69-4670-b0fd-a1c013f041d6 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:59.978632 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e20081a3-ca69-4670-b0fd-a1c013f041d6 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:59.987640 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e20081a3-ca69-4670-b0fd-a1c013f041d6 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:59.988562 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e20081a3-ca69-4670-b0fd-a1c013f041d6 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:59.989381 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e20081a3-ca69-4670-b0fd-a1c013f041d6 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:59.989814 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e20081a3-ca69-4670-b0fd-a1c013f041d6 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:00.064242 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e20081a3-ca69-4670-b0fd-a1c013f041d6 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:00.072566 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e20081a3-ca69-4670-b0fd-a1c013f041d6 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1288 microversion: 2.1 time: 0.104352 Jul 18 10:52:00.073179 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 282/594] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:59 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1288 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:00.238243 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-6df07d39-a13a-44b4-bdd0-39d496efd8f8 req-71230ba3-49e9-4dbc-a8cf-96c3359db876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d05192-b009-41ab-861b-b66d0352d41e", "name": "network-vif-deleted", "tag": "abd1fe5c-3f12-4f5e-a659-6f5e05dab0ae"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:00.249352 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-6df07d39-a13a-44b4-bdd0-39d496efd8f8 req-71230ba3-49e9-4dbc-a8cf-96c3359db876 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:00.250082 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-6df07d39-a13a-44b4-bdd0-39d496efd8f8 req-71230ba3-49e9-4dbc-a8cf-96c3359db876 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:00.268460 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-6df07d39-a13a-44b4-bdd0-39d496efd8f8 req-71230ba3-49e9-4dbc-a8cf-96c3359db876 service nova] Creating event network-vif-deleted:abd1fe5c-3f12-4f5e-a659-6f5e05dab0ae for instance 14d05192-b009-41ab-861b-b66d0352d41e on hv-cinder-84949 Jul 18 10:52:00.280476 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-6df07d39-a13a-44b4-bdd0-39d496efd8f8 req-71230ba3-49e9-4dbc-a8cf-96c3359db876 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046772 Jul 18 10:52:00.281517 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 313/595] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:00.754680 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-718774fa-d7f1-40d5-acf7-19db93d74ee3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:00.755271 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-718774fa-d7f1-40d5-acf7-19db93d74ee3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:00.762124 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-718774fa-d7f1-40d5-acf7-19db93d74ee3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:00.762669 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-718774fa-d7f1-40d5-acf7-19db93d74ee3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:00.763533 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-718774fa-d7f1-40d5-acf7-19db93d74ee3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:00.764040 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-718774fa-d7f1-40d5-acf7-19db93d74ee3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:00.799117 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-718774fa-d7f1-40d5-acf7-19db93d74ee3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:00.799674 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-718774fa-d7f1-40d5-acf7-19db93d74ee3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:00.800135 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-718774fa-d7f1-40d5-acf7-19db93d74ee3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lazy-loading 'fault' on Instance uuid 14d05192-b009-41ab-861b-b66d0352d41e {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:52:00.844665 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-718774fa-d7f1-40d5-acf7-19db93d74ee3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:00.852580 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-718774fa-d7f1-40d5-acf7-19db93d74ee3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:00.854719 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-718774fa-d7f1-40d5-acf7-19db93d74ee3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:00.855858 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-718774fa-d7f1-40d5-acf7-19db93d74ee3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 200 len: 1372 microversion: 2.20 time: 0.105915 Jul 18 10:52:00.856433 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 283/596] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:52:00 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:52:01.092365 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-7add358d-0dd2-4b30-b666-8e748108dfa1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:01.093120 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-7add358d-0dd2-4b30-b666-8e748108dfa1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:01.095620 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:01.100717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7add358d-0dd2-4b30-b666-8e748108dfa1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:01.108180 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7add358d-0dd2-4b30-b666-8e748108dfa1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:01.108180 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7add358d-0dd2-4b30-b666-8e748108dfa1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:01.108180 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7add358d-0dd2-4b30-b666-8e748108dfa1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:01.223380 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7add358d-0dd2-4b30-b666-8e748108dfa1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:01.229682 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-7add358d-0dd2-4b30-b666-8e748108dfa1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1294 microversion: 2.1 time: 0.141939 Jul 18 10:52:01.230282 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 314/597] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:01 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1294 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:01.875268 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6ff55bca-88ea-4dd8-a75d-8625994b4494 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:01.876513 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-6ff55bca-88ea-4dd8-a75d-8625994b4494 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:01.883342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6ff55bca-88ea-4dd8-a75d-8625994b4494 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:01.883782 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6ff55bca-88ea-4dd8-a75d-8625994b4494 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:01.885276 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6ff55bca-88ea-4dd8-a75d-8625994b4494 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:01.885943 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6ff55bca-88ea-4dd8-a75d-8625994b4494 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:01.899925 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-6ff55bca-88ea-4dd8-a75d-8625994b4494 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] HTTP exception thrown: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6ff55bca-88ea-4dd8-a75d-8625994b4494 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Request method failure captured: Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e HTTP/1.1 Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1To3O2fmmtSjU_HkOy8YHM_7tWfsIx_ZuUjyiG8wWFD1uvcFvJCOhVb6O9czo_URO0KWmSEgLogMyxbYkgGg6jOeHyJfOlZ8Zwi8pitLbpLHfRXJxXkJsrp3UDjRwsunM_lQ-edIQN56EpNRA45WJzZBDX-ueRIcHFw5T6UQrsp-WP8 Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 48497435674b41ccb34f6ff43026a232 Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:52:01.902549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:52:01.904014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/48497435674b41ccb34f6ff43026a232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_48497435674b41ccb34f6ff43026a232"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/48497435674b41ccb34f6ff43026a232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/48497435674b41ccb34f6ff43026a232"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:52:01.904014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:52:01.904014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 48497435674b41ccb34f6ff43026a232 Jul 18 10:52:01.904014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:52:01.904014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-AttachVolumeShelveTestJSON-41570772-project Jul 18 10:52:01.904014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:52:01.904014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:52:01.904014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 7e032c8e5b024fa7a41cd1090e0f1ada Jul 18 10:52:01.904014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-AttachVolumeShelveTestJSON-41570772-project Jul 18 10:52:01.904014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:52:01.904014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. Jul 18 10:52:01.904014 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '14d05192-b009-41ab-861b-b66d0352d41e'} Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:52:01.904821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. Jul 18 10:52:01.906029 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:52:01.907151 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6ff55bca-88ea-4dd8-a75d-8625994b4494 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Returning 404 to user: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:52:01.907151 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-6ff55bca-88ea-4dd8-a75d-8625994b4494 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 404 len: 111 microversion: 2.20 time: 0.032314 Jul 18 10:52:01.907151 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 284/598] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:52:01 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:52:01.913588 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-eef9bbfa-354e-4574-8c9a-a6b9b8bc4337 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '.version_select at 0x7f6364b341f0>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:02.013657 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-eef9bbfa-354e-4574-8c9a-a6b9b8bc4337 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650786775" status: 204 len: 0 microversion: 2.20 time: 0.104331 Jul 18 10:52:02.014314 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 315/599] 10.222.0.49 () {60 vars in 1261 bytes} [Mon Jul 18 10:52:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650786775 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 10:52:02.247874 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-fa179d25-db1a-4f1d-a66a-64f77ab16c21 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:02.248957 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-fa179d25-db1a-4f1d-a66a-64f77ab16c21 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:02.260403 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fa179d25-db1a-4f1d-a66a-64f77ab16c21 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:02.261067 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fa179d25-db1a-4f1d-a66a-64f77ab16c21 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:02.262228 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fa179d25-db1a-4f1d-a66a-64f77ab16c21 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:02.262810 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fa179d25-db1a-4f1d-a66a-64f77ab16c21 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:02.489524 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-fa179d25-db1a-4f1d-a66a-64f77ab16c21 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:02.499285 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-fa179d25-db1a-4f1d-a66a-64f77ab16c21 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1361 microversion: 2.1 time: 0.255721 Jul 18 10:52:02.500456 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 285/600] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:02 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1361 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:02.640795 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-34b27448-d926-4853-81fb-b1d4f64a7a4f req-d88b36a0-89f2-49ff-b147-bf199a0cc1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9", "tag": "47325516-1ea0-48d9-af9c-813d48dafa61"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:02.651394 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-34b27448-d926-4853-81fb-b1d4f64a7a4f req-d88b36a0-89f2-49ff-b147-bf199a0cc1e9 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:02.657206 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-34b27448-d926-4853-81fb-b1d4f64a7a4f req-d88b36a0-89f2-49ff-b147-bf199a0cc1e9 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:02.669019 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-34b27448-d926-4853-81fb-b1d4f64a7a4f req-d88b36a0-89f2-49ff-b147-bf199a0cc1e9 service nova] Creating event network-changed:47325516-1ea0-48d9-af9c-813d48dafa61 for instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 on hv-cinder-84949 Jul 18 10:52:02.674018 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-34b27448-d926-4853-81fb-b1d4f64a7a4f req-d88b36a0-89f2-49ff-b147-bf199a0cc1e9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037361 Jul 18 10:52:02.674717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 316/601] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:02.925787 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-33418956-6b24-40f1-b639-cc875df59e57 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Action: 'create', calling method: .version_select at 0x7f6364d03160>, body: {"keypair": {"name": "tempest-keypair-1683906143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOd00xYxKsbQ55whx5jtab6sOtmxLr7iMJeNYb9bxVmEFmNv93aApv037BebDPVAaI3TxrM3ylQ477BRfycT9lNZPoLZ6uv59P0kPSI+QbhQ6ta9g5gmVFYUn3hd8M32lw=="}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:02.941216 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-33418956-6b24-40f1-b639-cc875df59e57 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Getting quotas for project 48497435674b41ccb34f6ff43026a232. Resources: {'key_pairs'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:52:02.945353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-33418956-6b24-40f1-b639-cc875df59e57 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Getting quotas for user 7e032c8e5b024fa7a41cd1090e0f1ada and project 48497435674b41ccb34f6ff43026a232. Resources: {'key_pairs'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:52:03.030657 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-33418956-6b24-40f1-b639-cc875df59e57 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.108785 Jul 18 10:52:03.031245 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 286/602] 10.222.0.49 () {62 vars in 1199 bytes} [Mon Jul 18 10:52:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 10:52:03.517554 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4cbe9509-2813-4985-84ce-3c708d5c9c3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:03.518291 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-4cbe9509-2813-4985-84ce-3c708d5c9c3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:03.524728 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4cbe9509-2813-4985-84ce-3c708d5c9c3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:03.525208 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4cbe9509-2813-4985-84ce-3c708d5c9c3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:03.525965 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4cbe9509-2813-4985-84ce-3c708d5c9c3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:03.526423 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4cbe9509-2813-4985-84ce-3c708d5c9c3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:03.541768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:03.676518 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-4cbe9509-2813-4985-84ce-3c708d5c9c3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:03.684714 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4cbe9509-2813-4985-84ce-3c708d5c9c3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1361 microversion: 2.1 time: 0.171478 Jul 18 10:52:03.685314 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 317/603] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:03 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:04.703503 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5bc617b4-b54c-4bd1-b802-cbe6f93445d0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:04.704046 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5bc617b4-b54c-4bd1-b802-cbe6f93445d0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:04.710862 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5bc617b4-b54c-4bd1-b802-cbe6f93445d0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:04.711304 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5bc617b4-b54c-4bd1-b802-cbe6f93445d0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:04.712065 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5bc617b4-b54c-4bd1-b802-cbe6f93445d0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:04.713399 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5bc617b4-b54c-4bd1-b802-cbe6f93445d0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:04.942536 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5bc617b4-b54c-4bd1-b802-cbe6f93445d0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:04.951707 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5bc617b4-b54c-4bd1-b802-cbe6f93445d0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1361 microversion: 2.1 time: 0.252741 Jul 18 10:52:04.952390 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 287/604] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:04 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:05.969980 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-fe485c1c-bcf1-409a-b3cf-91a73c1aa290 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:05.970575 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-fe485c1c-bcf1-409a-b3cf-91a73c1aa290 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:05.978685 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fe485c1c-bcf1-409a-b3cf-91a73c1aa290 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:05.979143 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fe485c1c-bcf1-409a-b3cf-91a73c1aa290 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:05.980409 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fe485c1c-bcf1-409a-b3cf-91a73c1aa290 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:05.980864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fe485c1c-bcf1-409a-b3cf-91a73c1aa290 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:06.111195 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1930178612", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cacd27b7-b866-4702-aa51-5895ad956ffc"}], "security_groups": [{"name": "tempest-securitygroup--246294011"}], "key_name": "tempest-keypair-1683906143", "user_data": "}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:06.123662 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-fe485c1c-bcf1-409a-b3cf-91a73c1aa290 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:06.131961 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-fe485c1c-bcf1-409a-b3cf-91a73c1aa290 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1361 microversion: 2.1 time: 0.166465 Jul 18 10:52:06.132603 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 318/605] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:05 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:06.216294 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.network.neutron [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] validate_networks() for [('cacd27b7-b866-4702-aa51-5895ad956ffc', None, None, None, None, None)] {{(pid=125005) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:52:06.601730 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Flavor limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:52:06.602236 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Image limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:52:06.604226 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Flavor pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:52:06.604226 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Image pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:52:06.604226 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:52:06.613622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:06.614077 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:06.614838 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:06.615261 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:06.632672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Getting quotas for project 48497435674b41ccb34f6ff43026a232. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:52:06.637107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Getting quotas for user 7e032c8e5b024fa7a41cd1090e0f1ada and project 48497435674b41ccb34f6ff43026a232. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:52:06.648559 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Going to run 1 instances... {{(pid=125005) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:52:06.651436 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125005) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:52:06.814626 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-06c79bcf-4c5d-41c2-ba9b-b55a40fc6305 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.707857 Jul 18 10:52:06.815276 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 288/606] 10.222.0.49 () {62 vars in 1187 bytes} [Mon Jul 18 10:52:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 10:52:06.826244 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-11e09981-0ba9-48ab-8e67-c8c860be09c8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:06.826858 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-11e09981-0ba9-48ab-8e67-c8c860be09c8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:06.885636 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-11e09981-0ba9-48ab-8e67-c8c860be09c8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:06.893703 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-11e09981-0ba9-48ab-8e67-c8c860be09c8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:06.895383 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-11e09981-0ba9-48ab-8e67-c8c860be09c8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:06.896626 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-11e09981-0ba9-48ab-8e67-c8c860be09c8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1282 microversion: 2.20 time: 0.074860 Jul 18 10:52:06.897289 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 319/607] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:52:06 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:52:07.149030 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-fda18599-ec18-40fd-8eab-75953ed663bf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:07.150256 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-fda18599-ec18-40fd-8eab-75953ed663bf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:07.156990 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fda18599-ec18-40fd-8eab-75953ed663bf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:07.157439 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fda18599-ec18-40fd-8eab-75953ed663bf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:07.158205 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fda18599-ec18-40fd-8eab-75953ed663bf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:07.158639 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fda18599-ec18-40fd-8eab-75953ed663bf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:07.303090 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-fda18599-ec18-40fd-8eab-75953ed663bf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:07.310946 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-fda18599-ec18-40fd-8eab-75953ed663bf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1361 microversion: 2.1 time: 0.165912 Jul 18 10:52:07.311548 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 289/608] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:07 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:07.916457 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-49774163-a5ca-41a1-aa9f-d582c218feb8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:07.917146 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-49774163-a5ca-41a1-aa9f-d582c218feb8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:07.919545 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=2 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:07.924628 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-49774163-a5ca-41a1-aa9f-d582c218feb8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:07.925110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-49774163-a5ca-41a1-aa9f-d582c218feb8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:07.925880 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-49774163-a5ca-41a1-aa9f-d582c218feb8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:07.926321 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-49774163-a5ca-41a1-aa9f-d582c218feb8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:07.991030 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-49774163-a5ca-41a1-aa9f-d582c218feb8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:07.999783 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-49774163-a5ca-41a1-aa9f-d582c218feb8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:08.001326 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-49774163-a5ca-41a1-aa9f-d582c218feb8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:08.002693 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-49774163-a5ca-41a1-aa9f-d582c218feb8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1286 microversion: 2.20 time: 0.090735 Jul 18 10:52:08.003259 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 320/609] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:52:07 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:52:08.328602 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d79b073e-ba04-4cb2-995d-ad43a68bbdb3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:08.329519 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d79b073e-ba04-4cb2-995d-ad43a68bbdb3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:08.336022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d79b073e-ba04-4cb2-995d-ad43a68bbdb3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:08.336475 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d79b073e-ba04-4cb2-995d-ad43a68bbdb3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:08.338165 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d79b073e-ba04-4cb2-995d-ad43a68bbdb3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:08.338380 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d79b073e-ba04-4cb2-995d-ad43a68bbdb3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:08.472273 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-9b1c0134-201b-4cfa-ab3c-f39f1b9c7c38 req-82a63894-1ba9-4447-8601-35b953044ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9", "name": "network-vif-plugged", "status": "completed", "tag": "47325516-1ea0-48d9-af9c-813d48dafa61"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:08.474117 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-d79b073e-ba04-4cb2-995d-ad43a68bbdb3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:08.482514 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d79b073e-ba04-4cb2-995d-ad43a68bbdb3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1361 microversion: 2.1 time: 0.157759 Jul 18 10:52:08.482725 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-9b1c0134-201b-4cfa-ab3c-f39f1b9c7c38 req-82a63894-1ba9-4447-8601-35b953044ae4 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:08.483268 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 290/610] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:08 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:08.483419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-9b1c0134-201b-4cfa-ab3c-f39f1b9c7c38 req-82a63894-1ba9-4447-8601-35b953044ae4 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:08.494980 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-9b1c0134-201b-4cfa-ab3c-f39f1b9c7c38 req-82a63894-1ba9-4447-8601-35b953044ae4 service nova] Creating event network-vif-plugged:47325516-1ea0-48d9-af9c-813d48dafa61 for instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 on hv-cinder-84949 Jul 18 10:52:08.500118 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-9b1c0134-201b-4cfa-ab3c-f39f1b9c7c38 req-82a63894-1ba9-4447-8601-35b953044ae4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031783 Jul 18 10:52:08.500577 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 321/611] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:09.021496 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8d22de3b-e31d-4c95-a7df-237e7f8e49b1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:09.022116 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8d22de3b-e31d-4c95-a7df-237e7f8e49b1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:09.028745 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8d22de3b-e31d-4c95-a7df-237e7f8e49b1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:09.029219 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8d22de3b-e31d-4c95-a7df-237e7f8e49b1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:09.029990 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8d22de3b-e31d-4c95-a7df-237e7f8e49b1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:09.030419 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8d22de3b-e31d-4c95-a7df-237e7f8e49b1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:09.129333 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8d22de3b-e31d-4c95-a7df-237e7f8e49b1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:09.139935 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8d22de3b-e31d-4c95-a7df-237e7f8e49b1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:09.142080 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8d22de3b-e31d-4c95-a7df-237e7f8e49b1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:09.142687 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8d22de3b-e31d-4c95-a7df-237e7f8e49b1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1342 microversion: 2.20 time: 0.125818 Jul 18 10:52:09.143252 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 291/612] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:52:09 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1342 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:52:09.500818 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0ab8161b-8472-469d-9c44-63db6e364edc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:09.501488 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-0ab8161b-8472-469d-9c44-63db6e364edc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:09.507816 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0ab8161b-8472-469d-9c44-63db6e364edc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:09.508253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0ab8161b-8472-469d-9c44-63db6e364edc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:09.509599 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0ab8161b-8472-469d-9c44-63db6e364edc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:09.510240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0ab8161b-8472-469d-9c44-63db6e364edc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:09.655004 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-0ab8161b-8472-469d-9c44-63db6e364edc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:09.662948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-0ab8161b-8472-469d-9c44-63db6e364edc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1361 microversion: 2.1 time: 0.166959 Jul 18 10:52:09.663522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 322/613] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:09 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:10.166677 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5aa33014-7175-4f99-ba54-819e43c94d09 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:10.167277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5aa33014-7175-4f99-ba54-819e43c94d09 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:10.174174 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5aa33014-7175-4f99-ba54-819e43c94d09 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:10.174609 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5aa33014-7175-4f99-ba54-819e43c94d09 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:10.175371 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5aa33014-7175-4f99-ba54-819e43c94d09 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:10.175800 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5aa33014-7175-4f99-ba54-819e43c94d09 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:10.380712 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5aa33014-7175-4f99-ba54-819e43c94d09 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:10.390700 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5aa33014-7175-4f99-ba54-819e43c94d09 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:10.392239 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5aa33014-7175-4f99-ba54-819e43c94d09 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:10.393470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5aa33014-7175-4f99-ba54-819e43c94d09 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1407 microversion: 2.20 time: 0.231467 Jul 18 10:52:10.394032 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 292/614] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:52:10 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:52:10.681362 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-aded9e1c-5a5b-4686-b185-c97b1793eb3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:10.682149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-aded9e1c-5a5b-4686-b185-c97b1793eb3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:10.689822 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-aded9e1c-5a5b-4686-b185-c97b1793eb3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:10.690278 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-aded9e1c-5a5b-4686-b185-c97b1793eb3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:10.691054 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-aded9e1c-5a5b-4686-b185-c97b1793eb3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:10.691490 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-aded9e1c-5a5b-4686-b185-c97b1793eb3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:10.831762 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-aded9e1c-5a5b-4686-b185-c97b1793eb3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:10.839730 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-aded9e1c-5a5b-4686-b185-c97b1793eb3b tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1361 microversion: 2.1 time: 0.162913 Jul 18 10:52:10.840303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 323/615] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:10 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:11.413664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-dff8c9a2-0b38-4a56-9cf9-209052523284 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:11.414335 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-dff8c9a2-0b38-4a56-9cf9-209052523284 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:11.421966 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-dff8c9a2-0b38-4a56-9cf9-209052523284 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:11.424129 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-dff8c9a2-0b38-4a56-9cf9-209052523284 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:11.424129 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-dff8c9a2-0b38-4a56-9cf9-209052523284 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:11.424129 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-dff8c9a2-0b38-4a56-9cf9-209052523284 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:11.637757 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-dff8c9a2-0b38-4a56-9cf9-209052523284 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:11.646033 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-dff8c9a2-0b38-4a56-9cf9-209052523284 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:11.647549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-dff8c9a2-0b38-4a56-9cf9-209052523284 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:11.649118 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-dff8c9a2-0b38-4a56-9cf9-209052523284 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1407 microversion: 2.20 time: 0.239480 Jul 18 10:52:11.649812 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 293/616] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:52:11 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:52:11.858185 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b2c5a6ca-0e18-4dcc-8cb8-f57e8e431456 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:11.859289 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b2c5a6ca-0e18-4dcc-8cb8-f57e8e431456 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:11.867755 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b2c5a6ca-0e18-4dcc-8cb8-f57e8e431456 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:11.868836 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b2c5a6ca-0e18-4dcc-8cb8-f57e8e431456 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:11.869658 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b2c5a6ca-0e18-4dcc-8cb8-f57e8e431456 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:11.870094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b2c5a6ca-0e18-4dcc-8cb8-f57e8e431456 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:12.085209 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b2c5a6ca-0e18-4dcc-8cb8-f57e8e431456 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:12.094625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b2c5a6ca-0e18-4dcc-8cb8-f57e8e431456 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1547 microversion: 2.1 time: 0.239716 Jul 18 10:52:12.095621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 324/617] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:11 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1547 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:12.112504 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b9ed51ff-cd22-4a6d-954b-4334f8cfca41 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:12.113038 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b9ed51ff-cd22-4a6d-954b-4334f8cfca41 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:12.119942 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b9ed51ff-cd22-4a6d-954b-4334f8cfca41 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:12.120392 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b9ed51ff-cd22-4a6d-954b-4334f8cfca41 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:12.121187 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b9ed51ff-cd22-4a6d-954b-4334f8cfca41 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:12.121620 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b9ed51ff-cd22-4a6d-954b-4334f8cfca41 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:12.219043 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b9ed51ff-cd22-4a6d-954b-4334f8cfca41 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110477 Jul 18 10:52:12.219689 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 294/618] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 18 10:52:12 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:12.427633 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-bc2018cc-f8c1-4f43-ba91-e1e68e9da0a0 req-12443ca9-bfc7-42fb-af1c-11afaa4ad4dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f1b361f-a048-4231-8c87-b3b27c478f7d", "tag": "e168237a-b0b4-42cb-8c89-d5ade5d9cf57"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:12.437248 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-bc2018cc-f8c1-4f43-ba91-e1e68e9da0a0 req-12443ca9-bfc7-42fb-af1c-11afaa4ad4dd service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:12.437476 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-bc2018cc-f8c1-4f43-ba91-e1e68e9da0a0 req-12443ca9-bfc7-42fb-af1c-11afaa4ad4dd service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:12.451332 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-bc2018cc-f8c1-4f43-ba91-e1e68e9da0a0 req-12443ca9-bfc7-42fb-af1c-11afaa4ad4dd service nova] Creating event network-changed:e168237a-b0b4-42cb-8c89-d5ade5d9cf57 for instance 4f1b361f-a048-4231-8c87-b3b27c478f7d on hv-cinder-84949 Jul 18 10:52:12.458087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-bc2018cc-f8c1-4f43-ba91-e1e68e9da0a0 req-12443ca9-bfc7-42fb-af1c-11afaa4ad4dd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034955 Jul 18 10:52:12.459666 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 325/619] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:52:12.669492 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-0c10c22d-c4a9-4831-b426-a86a6f258b20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:12.670041 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-0c10c22d-c4a9-4831-b426-a86a6f258b20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:12.676578 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0c10c22d-c4a9-4831-b426-a86a6f258b20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:12.677080 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0c10c22d-c4a9-4831-b426-a86a6f258b20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:12.677846 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0c10c22d-c4a9-4831-b426-a86a6f258b20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:12.678278 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0c10c22d-c4a9-4831-b426-a86a6f258b20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:13.037408 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0c10c22d-c4a9-4831-b426-a86a6f258b20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:13.046837 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0c10c22d-c4a9-4831-b426-a86a6f258b20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:13.048393 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0c10c22d-c4a9-4831-b426-a86a6f258b20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:13.049545 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-0c10c22d-c4a9-4831-b426-a86a6f258b20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1407 microversion: 2.20 time: 0.385995 Jul 18 10:52:13.050304 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 295/620] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:52:12 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1407 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:52:14.068715 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-7559c52a-2e23-4700-947f-338f29f0171f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:14.069439 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-7559c52a-2e23-4700-947f-338f29f0171f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:14.076708 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7559c52a-2e23-4700-947f-338f29f0171f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:14.077231 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7559c52a-2e23-4700-947f-338f29f0171f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:14.077998 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7559c52a-2e23-4700-947f-338f29f0171f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:14.078429 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7559c52a-2e23-4700-947f-338f29f0171f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:14.221523 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7559c52a-2e23-4700-947f-338f29f0171f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:14.230667 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7559c52a-2e23-4700-947f-338f29f0171f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:14.232103 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7559c52a-2e23-4700-947f-338f29f0171f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:14.233468 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-7559c52a-2e23-4700-947f-338f29f0171f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1407 microversion: 2.20 time: 0.169746 Jul 18 10:52:14.234034 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 326/621] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:52:14 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:52:14.474528 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-f8bd88a0-0506-42dd-b77d-ce0983aadbd8 req-bc794dcb-b41b-4f60-8c15-e9ee04ae93b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9", "tag": "47325516-1ea0-48d9-af9c-813d48dafa61"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:14.484414 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-f8bd88a0-0506-42dd-b77d-ce0983aadbd8 req-bc794dcb-b41b-4f60-8c15-e9ee04ae93b3 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:14.484882 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-f8bd88a0-0506-42dd-b77d-ce0983aadbd8 req-bc794dcb-b41b-4f60-8c15-e9ee04ae93b3 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:14.496177 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-f8bd88a0-0506-42dd-b77d-ce0983aadbd8 req-bc794dcb-b41b-4f60-8c15-e9ee04ae93b3 service nova] Creating event network-changed:47325516-1ea0-48d9-af9c-813d48dafa61 for instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 on hv-cinder-84949 Jul 18 10:52:14.501256 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-f8bd88a0-0506-42dd-b77d-ce0983aadbd8 req-bc794dcb-b41b-4f60-8c15-e9ee04ae93b3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030322 Jul 18 10:52:14.501849 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 296/622] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:15.252012 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-018fb8fd-47c9-40a2-b75c-85e71df562a9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:15.252686 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-018fb8fd-47c9-40a2-b75c-85e71df562a9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:15.264037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-018fb8fd-47c9-40a2-b75c-85e71df562a9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:15.273837 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-018fb8fd-47c9-40a2-b75c-85e71df562a9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:15.273837 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-018fb8fd-47c9-40a2-b75c-85e71df562a9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:15.273837 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-018fb8fd-47c9-40a2-b75c-85e71df562a9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:15.468499 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-018fb8fd-47c9-40a2-b75c-85e71df562a9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:15.479106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-018fb8fd-47c9-40a2-b75c-85e71df562a9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:15.480635 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-018fb8fd-47c9-40a2-b75c-85e71df562a9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:15.482199 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-018fb8fd-47c9-40a2-b75c-85e71df562a9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1407 microversion: 2.20 time: 0.233931 Jul 18 10:52:15.482921 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 327/623] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:52:15 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:52:16.501531 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9b04dcc5-6cab-405c-9bf5-88d9bab71f73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:16.502290 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-9b04dcc5-6cab-405c-9bf5-88d9bab71f73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:16.509680 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9b04dcc5-6cab-405c-9bf5-88d9bab71f73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:16.510224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9b04dcc5-6cab-405c-9bf5-88d9bab71f73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:16.511033 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9b04dcc5-6cab-405c-9bf5-88d9bab71f73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:16.511473 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9b04dcc5-6cab-405c-9bf5-88d9bab71f73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:16.624345 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=2 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:16.643792 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=16 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:16.662269 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9b04dcc5-6cab-405c-9bf5-88d9bab71f73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:16.671184 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9b04dcc5-6cab-405c-9bf5-88d9bab71f73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:16.672693 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9b04dcc5-6cab-405c-9bf5-88d9bab71f73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:16.679953 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9b04dcc5-6cab-405c-9bf5-88d9bab71f73 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1407 microversion: 2.20 time: 0.177417 Jul 18 10:52:16.679953 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 297/624] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:52:16 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:52:17.691518 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-826f0db2-9dc3-4248-80e7-f32b064ac16c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:17.692121 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-826f0db2-9dc3-4248-80e7-f32b064ac16c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:17.694625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=8 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:17.699744 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-826f0db2-9dc3-4248-80e7-f32b064ac16c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:17.700187 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-826f0db2-9dc3-4248-80e7-f32b064ac16c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:17.700999 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-826f0db2-9dc3-4248-80e7-f32b064ac16c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:17.701430 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-826f0db2-9dc3-4248-80e7-f32b064ac16c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:17.835702 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-826f0db2-9dc3-4248-80e7-f32b064ac16c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:17.844747 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-826f0db2-9dc3-4248-80e7-f32b064ac16c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:17.846309 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-826f0db2-9dc3-4248-80e7-f32b064ac16c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:17.847413 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-826f0db2-9dc3-4248-80e7-f32b064ac16c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1407 microversion: 2.20 time: 0.159837 Jul 18 10:52:17.848001 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 328/625] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:52:17 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:52:18.522987 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-a667eabd-0b21-4c01-b7f2-fb85103d91b6 req-ecfcc7b0-a44c-437c-81fd-9e78d0d00e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1b361f-a048-4231-8c87-b3b27c478f7d", "name": "network-vif-plugged", "status": "completed", "tag": "e168237a-b0b4-42cb-8c89-d5ade5d9cf57"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:18.532910 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-a667eabd-0b21-4c01-b7f2-fb85103d91b6 req-ecfcc7b0-a44c-437c-81fd-9e78d0d00e8f service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:18.533354 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-a667eabd-0b21-4c01-b7f2-fb85103d91b6 req-ecfcc7b0-a44c-437c-81fd-9e78d0d00e8f service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:18.537347 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=100 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:18.544853 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-a667eabd-0b21-4c01-b7f2-fb85103d91b6 req-ecfcc7b0-a44c-437c-81fd-9e78d0d00e8f service nova] Creating event network-vif-plugged:e168237a-b0b4-42cb-8c89-d5ade5d9cf57 for instance 4f1b361f-a048-4231-8c87-b3b27c478f7d on hv-cinder-84949 Jul 18 10:52:18.549734 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-a667eabd-0b21-4c01-b7f2-fb85103d91b6 req-ecfcc7b0-a44c-437c-81fd-9e78d0d00e8f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030833 Jul 18 10:52:18.550318 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 298/626] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:18.865867 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-cec966ad-6b0f-4af4-b12d-138429228cd8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:18.867191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-cec966ad-6b0f-4af4-b12d-138429228cd8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:18.874872 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cec966ad-6b0f-4af4-b12d-138429228cd8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:18.875309 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cec966ad-6b0f-4af4-b12d-138429228cd8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:18.876082 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cec966ad-6b0f-4af4-b12d-138429228cd8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:18.876509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cec966ad-6b0f-4af4-b12d-138429228cd8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:19.044882 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-cec966ad-6b0f-4af4-b12d-138429228cd8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:19.052859 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-cec966ad-6b0f-4af4-b12d-138429228cd8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:19.054363 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-cec966ad-6b0f-4af4-b12d-138429228cd8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:19.055487 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-cec966ad-6b0f-4af4-b12d-138429228cd8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1407 microversion: 2.20 time: 0.193558 Jul 18 10:52:19.056089 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 329/627] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:52:18 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:52:20.075538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-66dc5eb6-a457-4f20-84e6-74d6e5e72bc6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:20.076225 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-66dc5eb6-a457-4f20-84e6-74d6e5e72bc6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:20.083085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-66dc5eb6-a457-4f20-84e6-74d6e5e72bc6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:20.083530 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-66dc5eb6-a457-4f20-84e6-74d6e5e72bc6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:20.084290 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-66dc5eb6-a457-4f20-84e6-74d6e5e72bc6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:20.084723 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-66dc5eb6-a457-4f20-84e6-74d6e5e72bc6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:20.379529 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-66dc5eb6-a457-4f20-84e6-74d6e5e72bc6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:20.388052 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-66dc5eb6-a457-4f20-84e6-74d6e5e72bc6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:20.389578 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-66dc5eb6-a457-4f20-84e6-74d6e5e72bc6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:20.390684 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-66dc5eb6-a457-4f20-84e6-74d6e5e72bc6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1407 microversion: 2.20 time: 0.320658 Jul 18 10:52:20.391238 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 299/628] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:52:20 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:52:21.409228 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-fc684dbd-29da-4056-86b8-0aceb4823dba tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:21.409815 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-fc684dbd-29da-4056-86b8-0aceb4823dba tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:21.417503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fc684dbd-29da-4056-86b8-0aceb4823dba tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:21.417956 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fc684dbd-29da-4056-86b8-0aceb4823dba tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:21.418752 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fc684dbd-29da-4056-86b8-0aceb4823dba tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:21.419184 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fc684dbd-29da-4056-86b8-0aceb4823dba tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:21.556629 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-fc684dbd-29da-4056-86b8-0aceb4823dba tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:21.564883 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-fc684dbd-29da-4056-86b8-0aceb4823dba tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:21.566291 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-fc684dbd-29da-4056-86b8-0aceb4823dba tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:21.567424 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-fc684dbd-29da-4056-86b8-0aceb4823dba tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1598 microversion: 2.20 time: 0.162250 Jul 18 10:52:21.568117 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 330/629] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:52:21 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:52:21.585804 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a4cb3265-ea21-40a6-8678-ede81d393e2f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:21.586336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a4cb3265-ea21-40a6-8678-ede81d393e2f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:21.593254 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4cb3265-ea21-40a6-8678-ede81d393e2f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:21.593694 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4cb3265-ea21-40a6-8678-ede81d393e2f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:21.594463 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4cb3265-ea21-40a6-8678-ede81d393e2f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:21.594896 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a4cb3265-ea21-40a6-8678-ede81d393e2f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:21.674444 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a4cb3265-ea21-40a6-8678-ede81d393e2f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092617 Jul 18 10:52:21.675041 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 300/630] 10.222.0.49 () {60 vars in 1315 bytes} [Mon Jul 18 10:52:21 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:52:22.570030 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-680a3b5d-ed78-4b6e-aaf6-f57103f6ad8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:22.570598 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-680a3b5d-ed78-4b6e-aaf6-f57103f6ad8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:22.578339 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-680a3b5d-ed78-4b6e-aaf6-f57103f6ad8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:22.578801 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-680a3b5d-ed78-4b6e-aaf6-f57103f6ad8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:22.579598 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-680a3b5d-ed78-4b6e-aaf6-f57103f6ad8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:22.580031 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-680a3b5d-ed78-4b6e-aaf6-f57103f6ad8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:22.605151 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-680a3b5d-ed78-4b6e-aaf6-f57103f6ad8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/ips" status: 200 len: 150 microversion: 2.1 time: 0.039063 Jul 18 10:52:22.605750 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 331/631] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 18 10:52:22 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:22.740723 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-9674d64c-3627-4d84-8bef-bb1cce8be16e req-0be786a8-c1db-4c22-a3a8-80d829a7e430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f1b361f-a048-4231-8c87-b3b27c478f7d", "tag": "e168237a-b0b4-42cb-8c89-d5ade5d9cf57"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:22.752416 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-9674d64c-3627-4d84-8bef-bb1cce8be16e req-0be786a8-c1db-4c22-a3a8-80d829a7e430 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:22.752879 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-9674d64c-3627-4d84-8bef-bb1cce8be16e req-0be786a8-c1db-4c22-a3a8-80d829a7e430 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:22.764987 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-9674d64c-3627-4d84-8bef-bb1cce8be16e req-0be786a8-c1db-4c22-a3a8-80d829a7e430 service nova] Creating event network-changed:e168237a-b0b4-42cb-8c89-d5ade5d9cf57 for instance 4f1b361f-a048-4231-8c87-b3b27c478f7d on hv-cinder-84949 Jul 18 10:52:22.770138 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-9674d64c-3627-4d84-8bef-bb1cce8be16e req-0be786a8-c1db-4c22-a3a8-80d829a7e430 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035223 Jul 18 10:52:22.770986 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 301/632] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:24.560003 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-fe2a2f1e-b59b-44ba-bb66-56b5cc4a59c9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19e2cc90-9195-43d3-98c2-3610904ff190"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:24.561171 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-fe2a2f1e-b59b-44ba-bb66-56b5cc4a59c9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:24.567728 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fe2a2f1e-b59b-44ba-bb66-56b5cc4a59c9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:24.568175 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fe2a2f1e-b59b-44ba-bb66-56b5cc4a59c9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:24.568977 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fe2a2f1e-b59b-44ba-bb66-56b5cc4a59c9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:24.569408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fe2a2f1e-b59b-44ba-bb66-56b5cc4a59c9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:25.466322 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-fe2a2f1e-b59b-44ba-bb66-56b5cc4a59c9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "POST /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.910909 Jul 18 10:52:25.467199 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 332/633] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 18 10:52:24 2022] POST /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/os-volume_attachments => generated 194 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:25.699499 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d3103d54-05db-4a60-8c5b-7b5dd8859d4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:25.700176 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d3103d54-05db-4a60-8c5b-7b5dd8859d4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:25.702515 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:25.707680 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d3103d54-05db-4a60-8c5b-7b5dd8859d4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:25.708321 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d3103d54-05db-4a60-8c5b-7b5dd8859d4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:25.709216 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d3103d54-05db-4a60-8c5b-7b5dd8859d4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:25.709592 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d3103d54-05db-4a60-8c5b-7b5dd8859d4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:25.796028 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-d3103d54-05db-4a60-8c5b-7b5dd8859d4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lazy-loading 'services' on Instance uuid 48a4f543-a994-4897-8ced-5c04fed9ef50 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:52:26.192290 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d3103d54-05db-4a60-8c5b-7b5dd8859d4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "DELETE /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments/a19cf8de-afb4-48ee-a3df-ec5e8c0cb8e6" status: 202 len: 0 microversion: 2.1 time: 0.497436 Jul 18 10:52:26.192896 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 302/634] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 18 10:52:25 2022] DELETE /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments/a19cf8de-afb4-48ee-a3df-ec5e8c0cb8e6 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:52:26.203144 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a026d5c7-d7e0-4ce7-a8e1-e49afd5f846a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:26.204200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a026d5c7-d7e0-4ce7-a8e1-e49afd5f846a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:26.213798 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a026d5c7-d7e0-4ce7-a8e1-e49afd5f846a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:26.214245 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a026d5c7-d7e0-4ce7-a8e1-e49afd5f846a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:26.215018 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a026d5c7-d7e0-4ce7-a8e1-e49afd5f846a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:26.215451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a026d5c7-d7e0-4ce7-a8e1-e49afd5f846a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:26.245434 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a026d5c7-d7e0-4ce7-a8e1-e49afd5f846a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047041 Jul 18 10:52:26.246015 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 333/635] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:52:26 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:27.259549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f4cf7ad2-3717-492c-986b-1cc4c434bc52 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:27.260617 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f4cf7ad2-3717-492c-986b-1cc4c434bc52 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:27.267082 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f4cf7ad2-3717-492c-986b-1cc4c434bc52 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:27.267526 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f4cf7ad2-3717-492c-986b-1cc4c434bc52 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:27.268297 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f4cf7ad2-3717-492c-986b-1cc4c434bc52 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:27.268731 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f4cf7ad2-3717-492c-986b-1cc4c434bc52 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:27.303749 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f4cf7ad2-3717-492c-986b-1cc4c434bc52 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049792 Jul 18 10:52:27.304315 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 303/636] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:52:27 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:28.315976 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-fc1c7d78-2b4a-4c29-88d7-ac760bd18267 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:28.316950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-fc1c7d78-2b4a-4c29-88d7-ac760bd18267 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:28.325287 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fc1c7d78-2b4a-4c29-88d7-ac760bd18267 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:28.325732 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fc1c7d78-2b4a-4c29-88d7-ac760bd18267 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:28.326512 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fc1c7d78-2b4a-4c29-88d7-ac760bd18267 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:28.326952 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fc1c7d78-2b4a-4c29-88d7-ac760bd18267 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:28.358987 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-fc1c7d78-2b4a-4c29-88d7-ac760bd18267 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046921 Jul 18 10:52:28.359576 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 334/637] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:52:28 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:29.371308 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-dbdefdf9-51bd-40af-b2b8-f7e69f60af4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:29.372400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-dbdefdf9-51bd-40af-b2b8-f7e69f60af4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:29.379021 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-dbdefdf9-51bd-40af-b2b8-f7e69f60af4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:29.379480 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-dbdefdf9-51bd-40af-b2b8-f7e69f60af4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:29.380194 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-dbdefdf9-51bd-40af-b2b8-f7e69f60af4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:29.380634 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-dbdefdf9-51bd-40af-b2b8-f7e69f60af4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:29.413688 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-dbdefdf9-51bd-40af-b2b8-f7e69f60af4a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046396 Jul 18 10:52:29.414293 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 304/638] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:52:29 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:30.425830 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-41f18308-11cc-4b07-93e7-4d249cbf8995 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:30.426726 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-41f18308-11cc-4b07-93e7-4d249cbf8995 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:30.433768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-41f18308-11cc-4b07-93e7-4d249cbf8995 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:30.434212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-41f18308-11cc-4b07-93e7-4d249cbf8995 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:30.434975 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-41f18308-11cc-4b07-93e7-4d249cbf8995 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:30.435405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-41f18308-11cc-4b07-93e7-4d249cbf8995 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:30.449996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:30.466124 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-41f18308-11cc-4b07-93e7-4d249cbf8995 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044867 Jul 18 10:52:30.466963 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 335/639] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:52:30 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:31.478740 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-00678c8b-9d58-4107-bc9b-72cbc53649de tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:31.479662 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-00678c8b-9d58-4107-bc9b-72cbc53649de tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:31.486289 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-00678c8b-9d58-4107-bc9b-72cbc53649de tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:31.486777 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-00678c8b-9d58-4107-bc9b-72cbc53649de tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:31.487587 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-00678c8b-9d58-4107-bc9b-72cbc53649de tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:31.488020 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-00678c8b-9d58-4107-bc9b-72cbc53649de tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:31.520500 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-00678c8b-9d58-4107-bc9b-72cbc53649de tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046302 Jul 18 10:52:31.521099 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 305/640] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:52:31 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:32.532513 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-902f7b12-1d6e-4c6a-a930-064619a3c102 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:32.533479 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-902f7b12-1d6e-4c6a-a930-064619a3c102 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:32.541765 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-902f7b12-1d6e-4c6a-a930-064619a3c102 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:32.542047 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-902f7b12-1d6e-4c6a-a930-064619a3c102 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:32.542829 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-902f7b12-1d6e-4c6a-a930-064619a3c102 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:32.543299 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-902f7b12-1d6e-4c6a-a930-064619a3c102 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:32.576058 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-902f7b12-1d6e-4c6a-a930-064619a3c102 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047609 Jul 18 10:52:32.576647 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 336/641] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:52:32 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:52:33.588327 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-37653da0-052b-49c2-be49-fb888e69a685 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:33.589211 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-37653da0-052b-49c2-be49-fb888e69a685 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:33.596116 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-37653da0-052b-49c2-be49-fb888e69a685 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:33.596620 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-37653da0-052b-49c2-be49-fb888e69a685 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:33.597408 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-37653da0-052b-49c2-be49-fb888e69a685 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:33.597838 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-37653da0-052b-49c2-be49-fb888e69a685 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:33.629955 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-37653da0-052b-49c2-be49-fb888e69a685 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046057 Jul 18 10:52:33.630588 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 306/642] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:52:33 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:34.032800 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d9806f54-b358-45d5-b9ec-9d236fabed45 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19e2cc90-9195-43d3-98c2-3610904ff190"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:34.033904 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d9806f54-b358-45d5-b9ec-9d236fabed45 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:34.036193 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:34.042281 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d9806f54-b358-45d5-b9ec-9d236fabed45 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:34.042739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d9806f54-b358-45d5-b9ec-9d236fabed45 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:34.043546 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d9806f54-b358-45d5-b9ec-9d236fabed45 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:34.043985 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d9806f54-b358-45d5-b9ec-9d236fabed45 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:34.129118 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-d9806f54-b358-45d5-b9ec-9d236fabed45 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] HTTP exception thrown: Invalid volume: volume 19e2cc90-9195-43d3-98c2-3610904ff190 is already attached to instances: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d9806f54-b358-45d5-b9ec-9d236fabed45 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Request method failure captured: Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: POST /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/os-volume_attachments HTTP/1.1 Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 74 Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To3grVh5eba67sMHj3Z1DSA3fIUC9f5wIxOuVBPUD51Z7C3u9-HXpsXd8cB6k0mN-6p1y9OtAmiFcgdD3J1fX4g3yITPuNgpxLVfMocjGOIBC9EjXhO_0oCAHoqkj4rFWVIlBvaa2J_jvIj5l1Y1IoF1YPGIt2tFFq5BZ3pTrErcdc Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:52:34.131094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:52:34.132718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:52:34.132718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:52:34.132718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:52:34.132718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:52:34.132718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:52:34.132718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:52:34.132718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:52:34.132718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 3954fd4abf6b4c3a82280c762292a3e7 Jul 18 10:52:34.132718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:52:34.132718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Jul 18 10:52:34.132718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {"volumeAttachment": {"volumeId": "19e2cc90-9195-43d3-98c2-3610904ff190"}} Jul 18 10:52:34.132718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Invalid volume: volume 19e2cc90-9195-43d3-98c2-3610904ff190 is already attached to instances: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'server_id': '8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924', 'body': {'volumeAttachment': {'volumeId': '19e2cc90-9195-43d3-98c2-3610904ff190'}}} Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 19e2cc90-9195-43d3-98c2-3610904ff190 is already attached to instances: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:34.134390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 19e2cc90-9195-43d3-98c2-3610904ff190 is already attached to instances: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:34.135621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:52:34.136805 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:52:34.136805 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:52:34.136805 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:52:34.136805 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 19e2cc90-9195-43d3-98c2-3610904ff190 is already attached to instances: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 Jul 18 10:52:34.136805 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:34.136805 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d9806f54-b358-45d5-b9ec-9d236fabed45 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Returning 400 to user: Invalid volume: volume 19e2cc90-9195-43d3-98c2-3610904ff190 is already attached to instances: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:52:34.136805 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d9806f54-b358-45d5-b9ec-9d236fabed45 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "POST /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104284 Jul 18 10:52:34.136805 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 337/643] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 18 10:52:34 2022] POST /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:52:34.201525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-601908a3-5ce3-45d0-ba31-41c1aa80ba0b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:34.202871 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-601908a3-5ce3-45d0-ba31-41c1aa80ba0b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:34.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-601908a3-5ce3-45d0-ba31-41c1aa80ba0b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:34.208417 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-601908a3-5ce3-45d0-ba31-41c1aa80ba0b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:34.209341 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-601908a3-5ce3-45d0-ba31-41c1aa80ba0b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:34.209778 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-601908a3-5ce3-45d0-ba31-41c1aa80ba0b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:34.292317 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-601908a3-5ce3-45d0-ba31-41c1aa80ba0b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lazy-loading 'services' on Instance uuid 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:52:34.642528 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a6fa0db8-b59e-4695-ae78-e8825ba3ff79 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:34.643454 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a6fa0db8-b59e-4695-ae78-e8825ba3ff79 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:34.651247 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a6fa0db8-b59e-4695-ae78-e8825ba3ff79 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:34.651695 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a6fa0db8-b59e-4695-ae78-e8825ba3ff79 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:34.652473 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a6fa0db8-b59e-4695-ae78-e8825ba3ff79 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:34.652948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a6fa0db8-b59e-4695-ae78-e8825ba3ff79 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:34.682348 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a6fa0db8-b59e-4695-ae78-e8825ba3ff79 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043992 Jul 18 10:52:34.684567 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 338/644] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:52:34 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:52:34.725001 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-601908a3-5ce3-45d0-ba31-41c1aa80ba0b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/os-volume_attachments/19e2cc90-9195-43d3-98c2-3610904ff190" status: 202 len: 0 microversion: 2.1 time: 0.527280 Jul 18 10:52:34.725767 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 307/645] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 18 10:52:34 2022] DELETE /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/os-volume_attachments/19e2cc90-9195-43d3-98c2-3610904ff190 => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:52:34.735598 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f61ac081-c903-46ee-8121-b418ec6ec18c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:34.736644 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f61ac081-c903-46ee-8121-b418ec6ec18c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:34.743532 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f61ac081-c903-46ee-8121-b418ec6ec18c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:34.743978 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f61ac081-c903-46ee-8121-b418ec6ec18c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:34.744953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f61ac081-c903-46ee-8121-b418ec6ec18c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:34.745313 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f61ac081-c903-46ee-8121-b418ec6ec18c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:34.777484 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f61ac081-c903-46ee-8121-b418ec6ec18c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046934 Jul 18 10:52:34.777993 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 339/646] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:52:34 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:35.695293 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2017cfdf-2460-4e03-8322-c42d3e0c5bcb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:35.696481 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2017cfdf-2460-4e03-8322-c42d3e0c5bcb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:35.702889 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2017cfdf-2460-4e03-8322-c42d3e0c5bcb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:35.703352 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2017cfdf-2460-4e03-8322-c42d3e0c5bcb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:35.704110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2017cfdf-2460-4e03-8322-c42d3e0c5bcb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:35.704696 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2017cfdf-2460-4e03-8322-c42d3e0c5bcb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:35.735996 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2017cfdf-2460-4e03-8322-c42d3e0c5bcb tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045530 Jul 18 10:52:35.736685 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 308/647] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:52:35 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:52:35.797417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2208b13f-a0a4-47aa-9bfa-ed109c836d36 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:35.798641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2208b13f-a0a4-47aa-9bfa-ed109c836d36 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:35.823243 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2208b13f-a0a4-47aa-9bfa-ed109c836d36 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:35.825017 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2208b13f-a0a4-47aa-9bfa-ed109c836d36 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:35.825017 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2208b13f-a0a4-47aa-9bfa-ed109c836d36 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:35.825609 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5618bb3f-41ba-488f-b2ea-e2f9da70e4a6 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:35.825696 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2208b13f-a0a4-47aa-9bfa-ed109c836d36 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:35.825772 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5618bb3f-41ba-488f-b2ea-e2f9da70e4a6 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:35.832385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5618bb3f-41ba-488f-b2ea-e2f9da70e4a6 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:35.832868 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5618bb3f-41ba-488f-b2ea-e2f9da70e4a6 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:35.833644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5618bb3f-41ba-488f-b2ea-e2f9da70e4a6 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:35.834073 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5618bb3f-41ba-488f-b2ea-e2f9da70e4a6 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:35.859544 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2208b13f-a0a4-47aa-9bfa-ed109c836d36 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068272 Jul 18 10:52:35.860662 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 340/648] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:52:35 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:35.864187 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5618bb3f-41ba-488f-b2ea-e2f9da70e4a6 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Going to try to terminate instance {{(pid=125005) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:52:36.222367 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5618bb3f-41ba-488f-b2ea-e2f9da70e4a6 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "DELETE /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 204 len: 0 microversion: 2.1 time: 0.402029 Jul 18 10:52:36.222965 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 309/649] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:52:35 2022] DELETE /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 10:52:36.231311 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f4cb2445-fb1e-46bd-8739-18df78119eb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:36.231925 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f4cb2445-fb1e-46bd-8739-18df78119eb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:36.238652 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f4cb2445-fb1e-46bd-8739-18df78119eb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:36.239122 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f4cb2445-fb1e-46bd-8739-18df78119eb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:36.239907 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f4cb2445-fb1e-46bd-8739-18df78119eb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:36.240345 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f4cb2445-fb1e-46bd-8739-18df78119eb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:36.388813 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f4cb2445-fb1e-46bd-8739-18df78119eb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:36.397488 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f4cb2445-fb1e-46bd-8739-18df78119eb7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1688 microversion: 2.1 time: 0.169895 Jul 18 10:52:36.397971 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 341/650] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:36 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:36.872907 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-528c6e43-d5be-4d6f-a49f-314e262f9bd3 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:36.873934 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-528c6e43-d5be-4d6f-a49f-314e262f9bd3 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:36.880904 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-528c6e43-d5be-4d6f-a49f-314e262f9bd3 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:36.881354 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-528c6e43-d5be-4d6f-a49f-314e262f9bd3 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:36.882207 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-528c6e43-d5be-4d6f-a49f-314e262f9bd3 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:36.882655 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-528c6e43-d5be-4d6f-a49f-314e262f9bd3 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:36.917767 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-528c6e43-d5be-4d6f-a49f-314e262f9bd3 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049939 Jul 18 10:52:36.918417 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 310/651] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:52:36 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:52:36.986337 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6c1f566b-b11d-4f10-849e-e3e32224725e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:36.986908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6c1f566b-b11d-4f10-849e-e3e32224725e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:36.994589 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6c1f566b-b11d-4f10-849e-e3e32224725e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:36.995075 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6c1f566b-b11d-4f10-849e-e3e32224725e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:36.995905 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6c1f566b-b11d-4f10-849e-e3e32224725e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:36.996378 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6c1f566b-b11d-4f10-849e-e3e32224725e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:37.024360 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6c1f566b-b11d-4f10-849e-e3e32224725e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Going to try to terminate instance {{(pid=125007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:52:37.410415 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6c1f566b-b11d-4f10-849e-e3e32224725e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 204 len: 0 microversion: 2.1 time: 0.428002 Jul 18 10:52:37.410924 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 342/652] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:52:36 2022] DELETE /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:52:37.416232 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6a6ae3d3-c174-49f0-b435-2cda7c7cf3a2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:37.416860 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-6a6ae3d3-c174-49f0-b435-2cda7c7cf3a2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:37.420974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-55f89a71-05d6-4f70-af4f-16274c06da74 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:37.420974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-55f89a71-05d6-4f70-af4f-16274c06da74 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:37.424427 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6a6ae3d3-c174-49f0-b435-2cda7c7cf3a2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:37.424912 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6a6ae3d3-c174-49f0-b435-2cda7c7cf3a2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:37.425679 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6a6ae3d3-c174-49f0-b435-2cda7c7cf3a2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:37.426139 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6a6ae3d3-c174-49f0-b435-2cda7c7cf3a2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:37.426761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-55f89a71-05d6-4f70-af4f-16274c06da74 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:37.427217 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-55f89a71-05d6-4f70-af4f-16274c06da74 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:37.427995 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-55f89a71-05d6-4f70-af4f-16274c06da74 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:37.428432 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-55f89a71-05d6-4f70-af4f-16274c06da74 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:37.635834 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-55f89a71-05d6-4f70-af4f-16274c06da74 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:37.640179 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6a6ae3d3-c174-49f0-b435-2cda7c7cf3a2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:37.643713 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-55f89a71-05d6-4f70-af4f-16274c06da74 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1682 microversion: 2.1 time: 0.228285 Jul 18 10:52:37.644382 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 343/653] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:37 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1682 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:37.647991 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-6a6ae3d3-c174-49f0-b435-2cda7c7cf3a2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1688 microversion: 2.1 time: 0.235608 Jul 18 10:52:37.649810 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 311/654] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:37 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1688 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:38.662363 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8e3a1f62-b5dc-4ffa-8610-c8a1a60af62d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:38.662954 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-8e3a1f62-b5dc-4ffa-8610-c8a1a60af62d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:38.665838 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b0f5dccb-29b2-45ca-8c00-b6f91c2fa1be tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:38.666483 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b0f5dccb-29b2-45ca-8c00-b6f91c2fa1be tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:38.670066 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8e3a1f62-b5dc-4ffa-8610-c8a1a60af62d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:38.670519 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8e3a1f62-b5dc-4ffa-8610-c8a1a60af62d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:38.671297 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8e3a1f62-b5dc-4ffa-8610-c8a1a60af62d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:38.671732 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8e3a1f62-b5dc-4ffa-8610-c8a1a60af62d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:38.673538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b0f5dccb-29b2-45ca-8c00-b6f91c2fa1be tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:38.673988 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b0f5dccb-29b2-45ca-8c00-b6f91c2fa1be tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:38.674764 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b0f5dccb-29b2-45ca-8c00-b6f91c2fa1be tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:38.675197 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b0f5dccb-29b2-45ca-8c00-b6f91c2fa1be tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:38.879395 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-8e3a1f62-b5dc-4ffa-8610-c8a1a60af62d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:38.886815 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-b0f5dccb-29b2-45ca-8c00-b6f91c2fa1be tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:38.887846 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-8e3a1f62-b5dc-4ffa-8610-c8a1a60af62d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1682 microversion: 2.1 time: 0.229368 Jul 18 10:52:38.888445 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 344/655] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:38 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1682 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:38.894509 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b0f5dccb-29b2-45ca-8c00-b6f91c2fa1be tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1688 microversion: 2.1 time: 0.232731 Jul 18 10:52:38.895075 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 312/656] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:38 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1688 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:39.906193 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0d51324d-2a23-4162-a3a7-78002707d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:39.916980 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-0d51324d-2a23-4162-a3a7-78002707d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:39.916980 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0d51324d-2a23-4162-a3a7-78002707d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:39.917798 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-30a7ec8e-5ecf-4c8b-9a8e-e17cc3fd0650 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:39.918500 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0d51324d-2a23-4162-a3a7-78002707d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:39.918500 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0d51324d-2a23-4162-a3a7-78002707d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:39.918837 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-30a7ec8e-5ecf-4c8b-9a8e-e17cc3fd0650 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:39.919041 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0d51324d-2a23-4162-a3a7-78002707d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:39.924650 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-30a7ec8e-5ecf-4c8b-9a8e-e17cc3fd0650 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:39.925698 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-30a7ec8e-5ecf-4c8b-9a8e-e17cc3fd0650 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:39.926537 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-30a7ec8e-5ecf-4c8b-9a8e-e17cc3fd0650 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:39.926955 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-30a7ec8e-5ecf-4c8b-9a8e-e17cc3fd0650 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:39.944398 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:40.128451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-0d51324d-2a23-4162-a3a7-78002707d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:40.139477 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-30a7ec8e-5ecf-4c8b-9a8e-e17cc3fd0650 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:40.139773 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-0d51324d-2a23-4162-a3a7-78002707d4aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1682 microversion: 2.1 time: 0.235254 Jul 18 10:52:40.139773 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 345/657] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:39 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1682 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:40.141130 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-30a7ec8e-5ecf-4c8b-9a8e-e17cc3fd0650 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1688 microversion: 2.1 time: 0.231739 Jul 18 10:52:40.141712 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 313/658] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:39 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1688 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:41.158096 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-18cc891d-9066-425f-9644-19530dfc2e57 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:41.158767 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-18cc891d-9066-425f-9644-19530dfc2e57 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:41.159409 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2abecb96-bcdd-4e49-9b3b-183023c8219c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:41.160577 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2abecb96-bcdd-4e49-9b3b-183023c8219c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:41.166945 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18cc891d-9066-425f-9644-19530dfc2e57 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:41.167408 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18cc891d-9066-425f-9644-19530dfc2e57 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:41.168327 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18cc891d-9066-425f-9644-19530dfc2e57 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:41.168544 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2abecb96-bcdd-4e49-9b3b-183023c8219c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:41.168840 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-18cc891d-9066-425f-9644-19530dfc2e57 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:41.169035 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2abecb96-bcdd-4e49-9b3b-183023c8219c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:41.169823 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2abecb96-bcdd-4e49-9b3b-183023c8219c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:41.170258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2abecb96-bcdd-4e49-9b3b-183023c8219c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:41.694326 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-18cc891d-9066-425f-9644-19530dfc2e57 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:41.702204 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2abecb96-bcdd-4e49-9b3b-183023c8219c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:41.705239 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-18cc891d-9066-425f-9644-19530dfc2e57 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1688 microversion: 2.1 time: 0.551084 Jul 18 10:52:41.716438 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2abecb96-bcdd-4e49-9b3b-183023c8219c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1682 microversion: 2.1 time: 0.561991 Jul 18 10:52:41.716438 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 346/659] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:41 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1682 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:41.717252 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 314/660] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:41 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1688 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:42.658407 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-2da320c5-6130-40d9-abf5-16ac8e9e262c req-d8934950-32d2-45a7-8d07-d916f628f80e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a4f543-a994-4897-8ced-5c04fed9ef50", "name": "network-vif-deleted", "tag": "3ac1975d-f8dd-432b-8748-aa525919c851"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:42.671558 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-2da320c5-6130-40d9-abf5-16ac8e9e262c req-d8934950-32d2-45a7-8d07-d916f628f80e service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:42.676036 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-2da320c5-6130-40d9-abf5-16ac8e9e262c req-d8934950-32d2-45a7-8d07-d916f628f80e service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:42.686748 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-2da320c5-6130-40d9-abf5-16ac8e9e262c req-d8934950-32d2-45a7-8d07-d916f628f80e service nova] Creating event network-vif-deleted:3ac1975d-f8dd-432b-8748-aa525919c851 for instance 48a4f543-a994-4897-8ced-5c04fed9ef50 on hv-cinder-84949 Jul 18 10:52:42.692295 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-2da320c5-6130-40d9-abf5-16ac8e9e262c req-d8934950-32d2-45a7-8d07-d916f628f80e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037649 Jul 18 10:52:42.694106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 347/661] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:42.723753 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-4f62773c-6b0d-4a3a-a65b-dc63151e3c1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:42.724987 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-4f62773c-6b0d-4a3a-a65b-dc63151e3c1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:42.733048 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4f62773c-6b0d-4a3a-a65b-dc63151e3c1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:42.733822 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4f62773c-6b0d-4a3a-a65b-dc63151e3c1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:42.734890 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4f62773c-6b0d-4a3a-a65b-dc63151e3c1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:42.735500 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4f62773c-6b0d-4a3a-a65b-dc63151e3c1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:42.745822 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d70a3bea-f297-4a9a-9f2e-0555a7f9c740 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:42.746653 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d70a3bea-f297-4a9a-9f2e-0555a7f9c740 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:42.768577 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d70a3bea-f297-4a9a-9f2e-0555a7f9c740 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:42.769058 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d70a3bea-f297-4a9a-9f2e-0555a7f9c740 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:42.770728 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d70a3bea-f297-4a9a-9f2e-0555a7f9c740 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:42.771394 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d70a3bea-f297-4a9a-9f2e-0555a7f9c740 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:42.909296 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4f62773c-6b0d-4a3a-a65b-dc63151e3c1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:42.930061 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-4f62773c-6b0d-4a3a-a65b-dc63151e3c1d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1621 microversion: 2.1 time: 0.205210 Jul 18 10:52:42.933488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 315/662] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:42 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1621 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:42.969044 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d70a3bea-f297-4a9a-9f2e-0555a7f9c740 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:42.978251 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d70a3bea-f297-4a9a-9f2e-0555a7f9c740 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1614 microversion: 2.1 time: 0.244532 Jul 18 10:52:42.981599 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 348/663] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:42 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1614 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:43.000208 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-08cdb59c-c40f-4692-9451-eb2533675326 req-755177e3-d6dc-4f7a-85bd-442f668a3111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924", "name": "network-vif-deleted", "tag": "e30195bc-be76-4526-8e2b-0e9910a4d0ce"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:43.013647 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-08cdb59c-c40f-4692-9451-eb2533675326 req-755177e3-d6dc-4f7a-85bd-442f668a3111 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:43.019033 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-08cdb59c-c40f-4692-9451-eb2533675326 req-755177e3-d6dc-4f7a-85bd-442f668a3111 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:43.035482 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-08cdb59c-c40f-4692-9451-eb2533675326 req-755177e3-d6dc-4f7a-85bd-442f668a3111 service nova] Creating event network-vif-deleted:e30195bc-be76-4526-8e2b-0e9910a4d0ce for instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 on hv-cinder-84949 Jul 18 10:52:43.046421 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-08cdb59c-c40f-4692-9451-eb2533675326 req-755177e3-d6dc-4f7a-85bd-442f668a3111 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055729 Jul 18 10:52:43.047719 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 316/664] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:43.951659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a0c619c9-7866-4419-b482-09fd8f3457f2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:43.952282 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a0c619c9-7866-4419-b482-09fd8f3457f2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:43.959611 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0c619c9-7866-4419-b482-09fd8f3457f2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:43.960436 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0c619c9-7866-4419-b482-09fd8f3457f2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:43.962480 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0c619c9-7866-4419-b482-09fd8f3457f2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:43.963176 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0c619c9-7866-4419-b482-09fd8f3457f2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:44.002576 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0c619c9-7866-4419-b482-09fd8f3457f2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:44.003491 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0c619c9-7866-4419-b482-09fd8f3457f2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:44.004286 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-a0c619c9-7866-4419-b482-09fd8f3457f2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lazy-loading 'fault' on Instance uuid 48a4f543-a994-4897-8ced-5c04fed9ef50 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:52:44.033651 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3c3766b2-1594-4329-a568-f53bdf8f4d41 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:44.040747 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3c3766b2-1594-4329-a568-f53bdf8f4d41 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:44.053489 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a0c619c9-7866-4419-b482-09fd8f3457f2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:44.066697 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a0c619c9-7866-4419-b482-09fd8f3457f2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 200 len: 1335 microversion: 2.1 time: 0.118865 Jul 18 10:52:44.067913 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 349/665] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:43 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 1335 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:44.084704 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3c3766b2-1594-4329-a568-f53bdf8f4d41 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:44.085659 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3c3766b2-1594-4329-a568-f53bdf8f4d41 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:44.086756 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3c3766b2-1594-4329-a568-f53bdf8f4d41 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:44.088839 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3c3766b2-1594-4329-a568-f53bdf8f4d41 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:44.128588 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3c3766b2-1594-4329-a568-f53bdf8f4d41 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:44.129167 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3c3766b2-1594-4329-a568-f53bdf8f4d41 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:44.129691 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-3c3766b2-1594-4329-a568-f53bdf8f4d41 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lazy-loading 'fault' on Instance uuid 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:52:44.182473 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3c3766b2-1594-4329-a568-f53bdf8f4d41 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:44.191206 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3c3766b2-1594-4329-a568-f53bdf8f4d41 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 200 len: 1331 microversion: 2.1 time: 0.190885 Jul 18 10:52:44.192478 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 317/666] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:43 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 1331 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:45.094723 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b571c934-6cae-48a5-9ff5-41328bd0dfdd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:45.095349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b571c934-6cae-48a5-9ff5-41328bd0dfdd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 48a4f543-a994-4897-8ced-5c04fed9ef50] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:45.103016 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b571c934-6cae-48a5-9ff5-41328bd0dfdd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:45.103469 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b571c934-6cae-48a5-9ff5-41328bd0dfdd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:45.104277 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b571c934-6cae-48a5-9ff5-41328bd0dfdd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:45.104720 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b571c934-6cae-48a5-9ff5-41328bd0dfdd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:45.128118 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-b571c934-6cae-48a5-9ff5-41328bd0dfdd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] HTTP exception thrown: Instance 48a4f543-a994-4897-8ced-5c04fed9ef50 could not be found. Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b571c934-6cae-48a5-9ff5-41328bd0dfdd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Request method failure captured: Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 HTTP/1.1 Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To0Hl7Z7tH4wrosljtOhuMMHcXL6pbeD1JuHCgjD-oe7va1swEl_8GoI03QFcODlczAxCQbyvU0gTRqpouGzPswCVdRlGstD4W0yiS7plk3qIPQYhozJnU_oV-MWNpSc406Kvd4flOyJY-_9P0GucpgDhdqM1T2S-0iE92Vf0JN-p8 Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 7184d0f3256344a2af18c639787e538f Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1177899909 Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:52:45.131596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:52:45.134772 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7184d0f3256344a2af18c639787e538f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7184d0f3256344a2af18c639787e538f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7184d0f3256344a2af18c639787e538f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7184d0f3256344a2af18c639787e538f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:52:45.134772 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1177899909 Jul 18 10:52:45.134772 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 7184d0f3256344a2af18c639787e538f Jul 18 10:52:45.134772 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1177899909 Jul 18 10:52:45.134772 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-ServerRescueNegativeTestJSON-1177899909-project Jul 18 10:52:45.134772 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:52:45.134772 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:52:45.134772 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: e7a738986f87470681c6a578599a089f Jul 18 10:52:45.134772 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1177899909-project Jul 18 10:52:45.134772 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:52:45.134772 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 48a4f543-a994-4897-8ced-5c04fed9ef50 could not be found. Jul 18 10:52:45.134772 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '48a4f543-a994-4897-8ced-5c04fed9ef50'} Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48a4f543-a994-4897-8ced-5c04fed9ef50 could not be found. Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:52:45.136037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48a4f543-a994-4897-8ced-5c04fed9ef50 could not be found. Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48a4f543-a994-4897-8ced-5c04fed9ef50 could not be found. Jul 18 10:52:45.138181 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:45.140127 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b571c934-6cae-48a5-9ff5-41328bd0dfdd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Returning 404 to user: Instance 48a4f543-a994-4897-8ced-5c04fed9ef50 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:52:45.140127 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b571c934-6cae-48a5-9ff5-41328bd0dfdd tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50" status: 404 len: 111 microversion: 2.1 time: 0.043927 Jul 18 10:52:45.140127 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 350/667] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:45 2022] GET /compute/v2.1/servers/48a4f543-a994-4897-8ced-5c04fed9ef50 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:52:45.148096 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-801d9b41-24a6-4303-b6e7-8fc6e719989a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '.version_select at 0x7f6364c828b0>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:45.213059 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2bd8cb6b-380b-4354-a67e-02133ba5931d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:45.213682 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2bd8cb6b-380b-4354-a67e-02133ba5931d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:45.220548 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2bd8cb6b-380b-4354-a67e-02133ba5931d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:45.221030 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2bd8cb6b-380b-4354-a67e-02133ba5931d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:45.221814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2bd8cb6b-380b-4354-a67e-02133ba5931d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:45.222246 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2bd8cb6b-380b-4354-a67e-02133ba5931d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:45.237743 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-2bd8cb6b-380b-4354-a67e-02133ba5931d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] HTTP exception thrown: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2bd8cb6b-380b-4354-a67e-02133ba5931d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Request method failure captured: Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 HTTP/1.1 Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To3grVh5eba67sMHj3Z1DSA3fIUC9f5wIxOuVBPUD51Z7C3u9-HXpsXd8cB6k0mN-6p1y9OtAmiFcgdD3J1fX4g3yITPuNgpxLVfMocjGOIBC9EjXhO_0oCAHoqkj4rFWVIlBvaa2J_jvIj5l1Y1IoF1YPGIt2tFFq5BZ3pTrErcdc Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:52:45.239263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:52:45.241029 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:52:45.241029 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:52:45.241029 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:52:45.241029 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:52:45.241029 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:52:45.241029 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:52:45.241029 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:52:45.241029 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 3954fd4abf6b4c3a82280c762292a3e7 Jul 18 10:52:45.241029 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:52:45.241029 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:52:45.241029 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. Jul 18 10:52:45.241029 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924'} Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:52:45.249320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. Jul 18 10:52:45.251495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:45.253451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2bd8cb6b-380b-4354-a67e-02133ba5931d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Returning 404 to user: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:52:45.253451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2bd8cb6b-380b-4354-a67e-02133ba5931d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 404 len: 111 microversion: 2.1 time: 0.033957 Jul 18 10:52:45.253451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 351/668] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:45 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:52:45.253451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-df68470c-1606-40e2-b51d-9f17cb924470 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '.version_select at 0x7f6364c1c3a0>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:45.281311 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-801d9b41-24a6-4303-b6e7-8fc6e719989a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-280716380" status: 202 len: 0 microversion: 2.1 time: 0.140779 Jul 18 10:52:45.281928 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 318/669] 10.222.0.49 () {58 vars in 1217 bytes} [Mon Jul 18 10:52:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-280716380 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:52:45.437664 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-df68470c-1606-40e2-b51d-9f17cb924470 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-190798423" status: 202 len: 0 microversion: 2.1 time: 0.191210 Jul 18 10:52:45.438268 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 352/670] 10.222.0.49 () {58 vars in 1217 bytes} [Mon Jul 18 10:52:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-190798423 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 10:52:46.785306 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7e5bf9b1-e438-4699-bade-53cdb33e765a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Action: 'create', calling method: .version_select at 0x7f6364d23ee0>, body: {"keypair": {"name": "tempest-keypair-1524473695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNt6BjQMwF6G43mM0EFb4hl9g37JKdsbdsN1Isqf64VyHct3j3upndXqs3mpzZv8Akyo+gLGtaLtX/KwIPy6/fhY3Zw3OlmKo2fmmznng2Ya7OeepnQpyxuc7aCYF5n6g=="}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:46.805230 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-7e5bf9b1-e438-4699-bade-53cdb33e765a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'key_pairs'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:52:46.812337 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-7e5bf9b1-e438-4699-bade-53cdb33e765a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for user 3954fd4abf6b4c3a82280c762292a3e7 and project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'key_pairs'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:52:46.939836 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7e5bf9b1-e438-4699-bade-53cdb33e765a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.161434 Jul 18 10:52:46.940995 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 319/671] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 18 10:52:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:52:49.228117 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2519567a-ea5c-4c92-aaaf-95df9093803b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:49.231539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2519567a-ea5c-4c92-aaaf-95df9093803b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:49.236890 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2519567a-ea5c-4c92-aaaf-95df9093803b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:49.237653 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2519567a-ea5c-4c92-aaaf-95df9093803b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:49.238652 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2519567a-ea5c-4c92-aaaf-95df9093803b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:49.239404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2519567a-ea5c-4c92-aaaf-95df9093803b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:49.244651 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:49.270391 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2519567a-ea5c-4c92-aaaf-95df9093803b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Going to try to terminate instance {{(pid=125007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:52:49.920504 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2519567a-ea5c-4c92-aaaf-95df9093803b tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 204 len: 0 microversion: 2.1 time: 0.697329 Jul 18 10:52:49.921670 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 353/672] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:52:49 2022] DELETE /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 10:52:49.933131 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-0b29cd39-7eca-455e-81f3-f2f0507e60ff tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:49.933868 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-0b29cd39-7eca-455e-81f3-f2f0507e60ff tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:49.944018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b29cd39-7eca-455e-81f3-f2f0507e60ff tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:49.945455 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b29cd39-7eca-455e-81f3-f2f0507e60ff tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:49.946882 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b29cd39-7eca-455e-81f3-f2f0507e60ff tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:49.947656 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b29cd39-7eca-455e-81f3-f2f0507e60ff tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:50.160718 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0b29cd39-7eca-455e-81f3-f2f0507e60ff tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:50.169848 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-0b29cd39-7eca-455e-81f3-f2f0507e60ff tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1507 microversion: 2.1 time: 0.243026 Jul 18 10:52:50.170429 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 320/673] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:49 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:50.332642 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-649354926", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfde60e0-9a8e-4b4d-8a28-cc720005757b"}], "security_groups": [{"name": "tempest-securitygroup--190966385"}], "key_name": "tempest-keypair-1524473695", "user_data": "}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:50.463204 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.network.neutron [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] validate_networks() for [('cfde60e0-9a8e-4b4d-8a28-cc720005757b', None, None, None, None, None)] {{(pid=125007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:52:50.998675 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Flavor limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:52:50.999094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Image limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:52:50.999565 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Flavor pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:52:51.000036 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Image pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:52:51.000442 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:52:51.011378 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:51.011821 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:51.012624 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:51.013086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:51.030444 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:52:51.034533 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Getting quotas for user 3954fd4abf6b4c3a82280c762292a3e7 and project 04716d82e1084ec58b2a4909710a6ce8. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:52:51.046663 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Going to run 1 instances... {{(pid=125007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:52:51.049039 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:52:51.193240 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e308099b-0403-4d87-ac11-f81f0447607d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:51.193840 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e308099b-0403-4d87-ac11-f81f0447607d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:51.200724 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e308099b-0403-4d87-ac11-f81f0447607d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:51.201240 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e308099b-0403-4d87-ac11-f81f0447607d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:51.201951 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e308099b-0403-4d87-ac11-f81f0447607d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:51.202372 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e308099b-0403-4d87-ac11-f81f0447607d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:51.263648 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d699f5d9-24a7-4593-b86f-659078177471 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.935949 Jul 18 10:52:51.264702 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 354/674] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:52:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:52:51.275906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-72465407-d6df-4ba9-9c5f-5b9681d071cf tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:51.276542 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-72465407-d6df-4ba9-9c5f-5b9681d071cf tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:51.344670 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-72465407-d6df-4ba9-9c5f-5b9681d071cf tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:51.352533 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-72465407-d6df-4ba9-9c5f-5b9681d071cf tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1241 microversion: 2.1 time: 0.081497 Jul 18 10:52:51.353374 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 355/675] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:51 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:51.374723 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e308099b-0403-4d87-ac11-f81f0447607d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:51.382447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e308099b-0403-4d87-ac11-f81f0447607d tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1507 microversion: 2.1 time: 0.192948 Jul 18 10:52:51.383090 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 321/676] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:51 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:52.370513 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-463e20ca-dd3a-4c87-b743-25a0301233ce tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:52.371078 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-463e20ca-dd3a-4c87-b743-25a0301233ce tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:52.400326 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-cc77f62e-c7d9-4d36-b886-68075cb3d306 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:52.401012 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-cc77f62e-c7d9-4d36-b886-68075cb3d306 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:52.410458 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cc77f62e-c7d9-4d36-b886-68075cb3d306 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:52.411474 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cc77f62e-c7d9-4d36-b886-68075cb3d306 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:52.411676 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cc77f62e-c7d9-4d36-b886-68075cb3d306 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:52.412395 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cc77f62e-c7d9-4d36-b886-68075cb3d306 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:52.427824 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-463e20ca-dd3a-4c87-b743-25a0301233ce tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:52.436883 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-463e20ca-dd3a-4c87-b743-25a0301233ce tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1241 microversion: 2.1 time: 0.070704 Jul 18 10:52:52.442398 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 356/677] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:52 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:52.569515 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-cc77f62e-c7d9-4d36-b886-68075cb3d306 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:52.577896 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-cc77f62e-c7d9-4d36-b886-68075cb3d306 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1507 microversion: 2.1 time: 0.182077 Jul 18 10:52:52.578553 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 322/678] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:52 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:52.899944 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-f6c27698-24ce-463f-9bc4-e172ac076d33 req-f39c198a-7de3-425a-8963-f8c9bffc85c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1449a0db-3f38-4456-8a45-7b4a40105095", "name": "network-vif-deleted", "tag": "fc6df403-f5e5-427c-868d-17653a05457d"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:52.909665 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-f6c27698-24ce-463f-9bc4-e172ac076d33 req-f39c198a-7de3-425a-8963-f8c9bffc85c7 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:52.910267 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-f6c27698-24ce-463f-9bc4-e172ac076d33 req-f39c198a-7de3-425a-8963-f8c9bffc85c7 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:52.924632 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-f6c27698-24ce-463f-9bc4-e172ac076d33 req-f39c198a-7de3-425a-8963-f8c9bffc85c7 service nova] Creating event network-vif-deleted:fc6df403-f5e5-427c-868d-17653a05457d for instance 1449a0db-3f38-4456-8a45-7b4a40105095 on hv-cinder-84949 Jul 18 10:52:52.930810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-f6c27698-24ce-463f-9bc4-e172ac076d33 req-f39c198a-7de3-425a-8963-f8c9bffc85c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100985 Jul 18 10:52:52.931433 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 357/679] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:53.455732 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5eaab75d-1afc-467b-b865-e4a8e79a7593 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:53.456346 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5eaab75d-1afc-467b-b865-e4a8e79a7593 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:53.463884 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5eaab75d-1afc-467b-b865-e4a8e79a7593 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:53.464330 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5eaab75d-1afc-467b-b865-e4a8e79a7593 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:53.465175 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5eaab75d-1afc-467b-b865-e4a8e79a7593 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:53.465611 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5eaab75d-1afc-467b-b865-e4a8e79a7593 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:53.530179 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5eaab75d-1afc-467b-b865-e4a8e79a7593 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:53.537776 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5eaab75d-1afc-467b-b865-e4a8e79a7593 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1293 microversion: 2.1 time: 0.086098 Jul 18 10:52:53.538937 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 323/680] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:53 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:53.596384 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d2221b61-10ed-41f2-bb56-e215642a264a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:53.597103 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d2221b61-10ed-41f2-bb56-e215642a264a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:53.603932 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d2221b61-10ed-41f2-bb56-e215642a264a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:53.604371 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d2221b61-10ed-41f2-bb56-e215642a264a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:53.605165 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d2221b61-10ed-41f2-bb56-e215642a264a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:53.605592 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d2221b61-10ed-41f2-bb56-e215642a264a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:53.638098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d2221b61-10ed-41f2-bb56-e215642a264a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:53.638536 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d2221b61-10ed-41f2-bb56-e215642a264a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:53.638980 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-d2221b61-10ed-41f2-bb56-e215642a264a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lazy-loading 'fault' on Instance uuid 1449a0db-3f38-4456-8a45-7b4a40105095 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:52:53.681330 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d2221b61-10ed-41f2-bb56-e215642a264a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:53.689051 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d2221b61-10ed-41f2-bb56-e215642a264a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 200 len: 1311 microversion: 2.1 time: 0.096839 Jul 18 10:52:53.689629 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 358/681] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:53 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:54.558384 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3101ed7a-fd9d-4a50-b9c1-482f56ee209a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:54.559010 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3101ed7a-fd9d-4a50-b9c1-482f56ee209a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:54.566556 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3101ed7a-fd9d-4a50-b9c1-482f56ee209a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:54.567152 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3101ed7a-fd9d-4a50-b9c1-482f56ee209a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:54.573054 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3101ed7a-fd9d-4a50-b9c1-482f56ee209a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:54.573545 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3101ed7a-fd9d-4a50-b9c1-482f56ee209a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:54.652966 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3101ed7a-fd9d-4a50-b9c1-482f56ee209a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:54.662353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3101ed7a-fd9d-4a50-b9c1-482f56ee209a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1301 microversion: 2.1 time: 0.108987 Jul 18 10:52:54.663937 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 324/682] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:54 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1301 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:54.707956 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8f184348-c3b6-44a9-97e6-f59bda77b221 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:54.708921 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-8f184348-c3b6-44a9-97e6-f59bda77b221 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 1449a0db-3f38-4456-8a45-7b4a40105095] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:54.716276 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f184348-c3b6-44a9-97e6-f59bda77b221 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:54.717160 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f184348-c3b6-44a9-97e6-f59bda77b221 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:54.718140 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f184348-c3b6-44a9-97e6-f59bda77b221 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:54.718763 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f184348-c3b6-44a9-97e6-f59bda77b221 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:54.735147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-8f184348-c3b6-44a9-97e6-f59bda77b221 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] HTTP exception thrown: Instance 1449a0db-3f38-4456-8a45-7b4a40105095 could not be found. Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8f184348-c3b6-44a9-97e6-f59bda77b221 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Request method failure captured: Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 HTTP/1.1 Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To0Hl7Z7tH4wrosljtOhuMMHcXL6pbeD1JuHCgjD-oe7va1swEl_8GoI03QFcODlczAxCQbyvU0gTRqpouGzPswCVdRlGstD4W0yiS7plk3qIPQYhozJnU_oV-MWNpSc406Kvd4flOyJY-_9P0GucpgDhdqM1T2S-0iE92Vf0JN-p8 Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 7184d0f3256344a2af18c639787e538f Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1177899909 Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:52:54.737090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:52:54.738692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7184d0f3256344a2af18c639787e538f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7184d0f3256344a2af18c639787e538f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7184d0f3256344a2af18c639787e538f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7184d0f3256344a2af18c639787e538f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:52:54.738692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1177899909 Jul 18 10:52:54.738692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 7184d0f3256344a2af18c639787e538f Jul 18 10:52:54.738692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1177899909 Jul 18 10:52:54.738692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-ServerRescueNegativeTestJSON-1177899909-project Jul 18 10:52:54.738692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:52:54.738692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:52:54.738692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: e7a738986f87470681c6a578599a089f Jul 18 10:52:54.738692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1177899909-project Jul 18 10:52:54.738692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:52:54.738692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 1449a0db-3f38-4456-8a45-7b4a40105095 could not be found. Jul 18 10:52:54.738692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '1449a0db-3f38-4456-8a45-7b4a40105095'} Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1449a0db-3f38-4456-8a45-7b4a40105095 could not be found. Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:52:54.739943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1449a0db-3f38-4456-8a45-7b4a40105095 could not be found. Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1449a0db-3f38-4456-8a45-7b4a40105095 could not be found. Jul 18 10:52:54.741370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:52:54.743257 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8f184348-c3b6-44a9-97e6-f59bda77b221 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Returning 404 to user: Instance 1449a0db-3f38-4456-8a45-7b4a40105095 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:52:54.743257 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-8f184348-c3b6-44a9-97e6-f59bda77b221 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095" status: 404 len: 111 microversion: 2.1 time: 0.034611 Jul 18 10:52:54.743435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 359/683] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:54 2022] GET /compute/v2.1/servers/1449a0db-3f38-4456-8a45-7b4a40105095 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:52:54.749071 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-01eeb03e-74e4-446c-9d4e-f8356bbd24e2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:54.749710 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-01eeb03e-74e4-446c-9d4e-f8356bbd24e2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:54.756218 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-01eeb03e-74e4-446c-9d4e-f8356bbd24e2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:54.757032 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-01eeb03e-74e4-446c-9d4e-f8356bbd24e2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:54.757998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-01eeb03e-74e4-446c-9d4e-f8356bbd24e2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:54.758438 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-01eeb03e-74e4-446c-9d4e-f8356bbd24e2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:54.786485 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-01eeb03e-74e4-446c-9d4e-f8356bbd24e2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Going to try to terminate instance {{(pid=125005) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:52:55.267129 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-01eeb03e-74e4-446c-9d4e-f8356bbd24e2 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 204 len: 0 microversion: 2.1 time: 0.522206 Jul 18 10:52:55.267726 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 325/684] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:52:54 2022] DELETE /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:52:55.277255 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-131463a4-6742-4773-8531-0a065e0fd9b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:55.277862 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-131463a4-6742-4773-8531-0a065e0fd9b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:55.284357 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-131463a4-6742-4773-8531-0a065e0fd9b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:55.284825 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-131463a4-6742-4773-8531-0a065e0fd9b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:55.285606 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-131463a4-6742-4773-8531-0a065e0fd9b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:55.286042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-131463a4-6742-4773-8531-0a065e0fd9b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:55.466780 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-131463a4-6742-4773-8531-0a065e0fd9b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:55.476433 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-131463a4-6742-4773-8531-0a065e0fd9b4 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.203750 Jul 18 10:52:55.477047 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 360/685] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:55 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:55.693710 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-cdae8e45-41ff-4960-85fb-3d1c0b35d130 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:55.694920 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-cdae8e45-41ff-4960-85fb-3d1c0b35d130 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:55.702339 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cdae8e45-41ff-4960-85fb-3d1c0b35d130 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:55.702782 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cdae8e45-41ff-4960-85fb-3d1c0b35d130 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:55.703662 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cdae8e45-41ff-4960-85fb-3d1c0b35d130 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:55.704096 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cdae8e45-41ff-4960-85fb-3d1c0b35d130 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:55.846631 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-cdae8e45-41ff-4960-85fb-3d1c0b35d130 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:55.855283 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-cdae8e45-41ff-4960-85fb-3d1c0b35d130 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1366 microversion: 2.1 time: 0.167206 Jul 18 10:52:55.856347 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 326/686] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:55 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:56.493818 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-57f8ef7a-3e2f-4dee-8230-9e56f6b7ae76 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:56.494443 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-57f8ef7a-3e2f-4dee-8230-9e56f6b7ae76 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:56.501310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-57f8ef7a-3e2f-4dee-8230-9e56f6b7ae76 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:56.501779 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-57f8ef7a-3e2f-4dee-8230-9e56f6b7ae76 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:56.502553 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-57f8ef7a-3e2f-4dee-8230-9e56f6b7ae76 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:56.503523 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-57f8ef7a-3e2f-4dee-8230-9e56f6b7ae76 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:56.642556 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-57f8ef7a-3e2f-4dee-8230-9e56f6b7ae76 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:56.653942 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-57f8ef7a-3e2f-4dee-8230-9e56f6b7ae76 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.164054 Jul 18 10:52:56.654531 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 361/687] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:56 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:56.873886 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-412d4789-4df9-4efc-8fab-b2ead8260f50 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:56.874486 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-412d4789-4df9-4efc-8fab-b2ead8260f50 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:56.876922 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=4 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:56.885890 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:56.885890 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-412d4789-4df9-4efc-8fab-b2ead8260f50 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:56.885890 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-412d4789-4df9-4efc-8fab-b2ead8260f50 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:56.885890 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-412d4789-4df9-4efc-8fab-b2ead8260f50 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:56.886323 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-412d4789-4df9-4efc-8fab-b2ead8260f50 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:57.029035 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-412d4789-4df9-4efc-8fab-b2ead8260f50 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:57.034983 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-412d4789-4df9-4efc-8fab-b2ead8260f50 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1366 microversion: 2.1 time: 0.164994 Jul 18 10:52:57.035560 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 327/688] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:56 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:57.649419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-80bd843b-4f55-40f9-8605-25102dfae63f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:57.649982 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-80bd843b-4f55-40f9-8605-25102dfae63f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:57.656506 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-80bd843b-4f55-40f9-8605-25102dfae63f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:57.657005 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-80bd843b-4f55-40f9-8605-25102dfae63f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:57.657781 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-80bd843b-4f55-40f9-8605-25102dfae63f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:57.658217 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-80bd843b-4f55-40f9-8605-25102dfae63f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:57.683316 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-80bd843b-4f55-40f9-8605-25102dfae63f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/ips" status: 200 len: 145 microversion: 2.1 time: 0.090536 Jul 18 10:52:57.683890 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 362/689] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 18 10:52:57 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/ips => generated 145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:57.703539 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9105473c-f8d3-44b4-acaf-31e0286bd32a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:57.704479 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-9105473c-f8d3-44b4-acaf-31e0286bd32a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:57.711336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9105473c-f8d3-44b4-acaf-31e0286bd32a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:57.711780 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9105473c-f8d3-44b4-acaf-31e0286bd32a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:57.712628 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9105473c-f8d3-44b4-acaf-31e0286bd32a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:57.713018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9105473c-f8d3-44b4-acaf-31e0286bd32a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:57.858928 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9105473c-f8d3-44b4-acaf-31e0286bd32a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:57.869527 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9105473c-f8d3-44b4-acaf-31e0286bd32a tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.167203 Jul 18 10:52:57.869527 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 328/690] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:57 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:58.053263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-1ee6badf-fcc2-4a11-9afb-88e317291348 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:58.053901 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-1ee6badf-fcc2-4a11-9afb-88e317291348 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:58.060464 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1ee6badf-fcc2-4a11-9afb-88e317291348 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:58.060936 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1ee6badf-fcc2-4a11-9afb-88e317291348 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:58.061706 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1ee6badf-fcc2-4a11-9afb-88e317291348 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:58.062131 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1ee6badf-fcc2-4a11-9afb-88e317291348 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:58.201632 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-1ee6badf-fcc2-4a11-9afb-88e317291348 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:58.209533 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-1ee6badf-fcc2-4a11-9afb-88e317291348 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1366 microversion: 2.1 time: 0.160166 Jul 18 10:52:58.210798 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 363/691] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:58 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:58.894690 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-16a88394-3a08-490f-9ec4-7381de8f5023 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:58.894690 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-16a88394-3a08-490f-9ec4-7381de8f5023 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:58.896741 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-16a88394-3a08-490f-9ec4-7381de8f5023 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:58.897222 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-16a88394-3a08-490f-9ec4-7381de8f5023 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:58.898125 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-16a88394-3a08-490f-9ec4-7381de8f5023 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:58.898596 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-16a88394-3a08-490f-9ec4-7381de8f5023 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:59.079248 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-0e9dd942-d1f8-4ecb-bd26-f0dab7b79d1b req-729ced03-0880-4585-989e-56c2e10e70a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9faaf917-748f-4856-8100-c52e60ae0543", "tag": "c81718ab-c440-4c7c-acd6-9b66da2b719c"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:59.099619 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-0e9dd942-d1f8-4ecb-bd26-f0dab7b79d1b req-729ced03-0880-4585-989e-56c2e10e70a7 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:59.100079 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-0e9dd942-d1f8-4ecb-bd26-f0dab7b79d1b req-729ced03-0880-4585-989e-56c2e10e70a7 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:59.120242 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-0e9dd942-d1f8-4ecb-bd26-f0dab7b79d1b req-729ced03-0880-4585-989e-56c2e10e70a7 service nova] Creating event network-changed:c81718ab-c440-4c7c-acd6-9b66da2b719c for instance 9faaf917-748f-4856-8100-c52e60ae0543 on hv-cinder-84949 Jul 18 10:52:59.126842 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-0e9dd942-d1f8-4ecb-bd26-f0dab7b79d1b req-729ced03-0880-4585-989e-56c2e10e70a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053716 Jul 18 10:52:59.131255 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 364/692] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:52:59.138968 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-16a88394-3a08-490f-9ec4-7381de8f5023 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:59.150886 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-16a88394-3a08-490f-9ec4-7381de8f5023 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1521 microversion: 2.1 time: 0.269237 Jul 18 10:52:59.162674 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 329/693] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:58 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:59.216746 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-24adf4fa-6fc4-436d-96a9-3477ae6ac62b req-5329af1d-8180-435e-9335-7dca06b9fcb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4728713a-e4cd-4e09-b104-7a57de4f2242", "name": "network-vif-deleted", "tag": "a2d9794f-2a33-4778-92a2-20c4de5af12b"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:59.229093 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-24adf4fa-6fc4-436d-96a9-3477ae6ac62b req-5329af1d-8180-435e-9335-7dca06b9fcb6 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:59.233232 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-24adf4fa-6fc4-436d-96a9-3477ae6ac62b req-5329af1d-8180-435e-9335-7dca06b9fcb6 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:59.233397 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e20e1227-4dcf-4b75-902a-795606a063c1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:59.233397 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e20e1227-4dcf-4b75-902a-795606a063c1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:59.242365 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e20e1227-4dcf-4b75-902a-795606a063c1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:59.243148 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e20e1227-4dcf-4b75-902a-795606a063c1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:59.243712 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-24adf4fa-6fc4-436d-96a9-3477ae6ac62b req-5329af1d-8180-435e-9335-7dca06b9fcb6 service nova] Creating event network-vif-deleted:a2d9794f-2a33-4778-92a2-20c4de5af12b for instance 4728713a-e4cd-4e09-b104-7a57de4f2242 on hv-cinder-84949 Jul 18 10:52:59.244968 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e20e1227-4dcf-4b75-902a-795606a063c1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:59.245640 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e20e1227-4dcf-4b75-902a-795606a063c1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:59.254667 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-24adf4fa-6fc4-436d-96a9-3477ae6ac62b req-5329af1d-8180-435e-9335-7dca06b9fcb6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125113 Jul 18 10:52:59.257895 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 365/694] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:59.400806 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-383c99ba-e207-4a3f-90e1-c65f94e4dfba tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76746fa1-3296-4b90-8925-970b76790e41"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:59.401771 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-383c99ba-e207-4a3f-90e1-c65f94e4dfba tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:59.409667 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-383c99ba-e207-4a3f-90e1-c65f94e4dfba tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:59.410224 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-383c99ba-e207-4a3f-90e1-c65f94e4dfba tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:59.411102 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-383c99ba-e207-4a3f-90e1-c65f94e4dfba tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:59.411784 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-383c99ba-e207-4a3f-90e1-c65f94e4dfba tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:59.506400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e20e1227-4dcf-4b75-902a-795606a063c1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:59.511120 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:59.517992 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e20e1227-4dcf-4b75-902a-795606a063c1 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1366 microversion: 2.1 time: 0.293980 Jul 18 10:52:59.524333 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 330/695] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:59 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:00.169225 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b829dfd7-0651-453c-9d16-4526bc748465 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:00.169929 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b829dfd7-0651-453c-9d16-4526bc748465 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:00.177350 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b829dfd7-0651-453c-9d16-4526bc748465 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:00.177799 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b829dfd7-0651-453c-9d16-4526bc748465 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:00.178570 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b829dfd7-0651-453c-9d16-4526bc748465 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:00.179022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b829dfd7-0651-453c-9d16-4526bc748465 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:00.211286 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b829dfd7-0651-453c-9d16-4526bc748465 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:00.211729 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b829dfd7-0651-453c-9d16-4526bc748465 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:00.212169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-b829dfd7-0651-453c-9d16-4526bc748465 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lazy-loading 'fault' on Instance uuid 4728713a-e4cd-4e09-b104-7a57de4f2242 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:53:00.273146 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-b829dfd7-0651-453c-9d16-4526bc748465 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a738986f87470681c6a578599a089f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7184d0f3256344a2af18c639787e538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:00.280668 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b829dfd7-0651-453c-9d16-4526bc748465 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 200 len: 1311 microversion: 2.1 time: 0.115169 Jul 18 10:53:00.281379 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 331/696] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:00 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:00.535270 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-be4b5cb8-f3b4-4680-ac20-099452404970 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:00.535879 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-be4b5cb8-f3b4-4680-ac20-099452404970 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:00.542952 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-be4b5cb8-f3b4-4680-ac20-099452404970 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:00.543475 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-be4b5cb8-f3b4-4680-ac20-099452404970 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:00.544265 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-be4b5cb8-f3b4-4680-ac20-099452404970 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:00.544721 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-be4b5cb8-f3b4-4680-ac20-099452404970 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:00.687853 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-be4b5cb8-f3b4-4680-ac20-099452404970 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:00.696176 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-be4b5cb8-f3b4-4680-ac20-099452404970 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1366 microversion: 2.1 time: 0.164461 Jul 18 10:53:00.696365 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 332/697] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:00 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:00.728925 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-383c99ba-e207-4a3f-90e1-c65f94e4dfba tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "POST /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.333352 Jul 18 10:53:00.729700 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 366/698] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 18 10:52:59 2022] POST /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments => generated 194 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:53:01.298209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-94d0fb49-00b0-4d2b-ac4e-1a83130e96a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:01.299002 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-94d0fb49-00b0-4d2b-ac4e-1a83130e96a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] [instance: 4728713a-e4cd-4e09-b104-7a57de4f2242] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:01.305484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-94d0fb49-00b0-4d2b-ac4e-1a83130e96a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:01.305931 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-94d0fb49-00b0-4d2b-ac4e-1a83130e96a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:01.306691 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-94d0fb49-00b0-4d2b-ac4e-1a83130e96a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:01.307115 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-94d0fb49-00b0-4d2b-ac4e-1a83130e96a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:01.321364 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-94d0fb49-00b0-4d2b-ac4e-1a83130e96a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] HTTP exception thrown: Instance 4728713a-e4cd-4e09-b104-7a57de4f2242 could not be found. Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-94d0fb49-00b0-4d2b-ac4e-1a83130e96a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Request method failure captured: Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 HTTP/1.1 Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1To0Hl7Z7tH4wrosljtOhuMMHcXL6pbeD1JuHCgjD-oe7va1swEl_8GoI03QFcODlczAxCQbyvU0gTRqpouGzPswCVdRlGstD4W0yiS7plk3qIPQYhozJnU_oV-MWNpSc406Kvd4flOyJY-_9P0GucpgDhdqM1T2S-0iE92Vf0JN-p8 Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 7184d0f3256344a2af18c639787e538f Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1177899909 Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:53:01.322989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:53:01.325197 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7184d0f3256344a2af18c639787e538f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7184d0f3256344a2af18c639787e538f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7184d0f3256344a2af18c639787e538f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7184d0f3256344a2af18c639787e538f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:53:01.325197 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1177899909 Jul 18 10:53:01.325197 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 7184d0f3256344a2af18c639787e538f Jul 18 10:53:01.325197 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1177899909 Jul 18 10:53:01.325197 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-ServerRescueNegativeTestJSON-1177899909-project Jul 18 10:53:01.325197 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:53:01.325197 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:53:01.325197 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: e7a738986f87470681c6a578599a089f Jul 18 10:53:01.325197 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1177899909-project Jul 18 10:53:01.325197 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:53:01.325197 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 4728713a-e4cd-4e09-b104-7a57de4f2242 could not be found. Jul 18 10:53:01.325197 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '4728713a-e4cd-4e09-b104-7a57de4f2242'} Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4728713a-e4cd-4e09-b104-7a57de4f2242 could not be found. Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:01.326104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4728713a-e4cd-4e09-b104-7a57de4f2242 could not be found. Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4728713a-e4cd-4e09-b104-7a57de4f2242 could not be found. Jul 18 10:53:01.327667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:01.329082 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-94d0fb49-00b0-4d2b-ac4e-1a83130e96a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] Returning 404 to user: Instance 4728713a-e4cd-4e09-b104-7a57de4f2242 could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:01.329082 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-94d0fb49-00b0-4d2b-ac4e-1a83130e96a7 tempest-ServerRescueNegativeTestJSON-1177899909 tempest-ServerRescueNegativeTestJSON-1177899909-project] 10.222.0.49 "GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242" status: 404 len: 111 microversion: 2.1 time: 0.030099 Jul 18 10:53:01.329082 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 333/699] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:01 2022] GET /compute/v2.1/servers/4728713a-e4cd-4e09-b104-7a57de4f2242 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:53:01.709853 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=2 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:01.716485 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-1e9ad641-8a11-4722-9fbd-e9c0cafbb56d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:01.717211 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-1e9ad641-8a11-4722-9fbd-e9c0cafbb56d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:01.725593 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1e9ad641-8a11-4722-9fbd-e9c0cafbb56d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:01.726041 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1e9ad641-8a11-4722-9fbd-e9c0cafbb56d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:01.727027 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1e9ad641-8a11-4722-9fbd-e9c0cafbb56d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:01.728111 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1e9ad641-8a11-4722-9fbd-e9c0cafbb56d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:01.887327 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-1e9ad641-8a11-4722-9fbd-e9c0cafbb56d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:01.895225 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-1e9ad641-8a11-4722-9fbd-e9c0cafbb56d tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1366 microversion: 2.1 time: 0.186726 Jul 18 10:53:01.904019 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 367/700] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:01 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:02.914932 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8a73578d-a845-4414-aa3a-8d071487bcaa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:02.915647 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8a73578d-a845-4414-aa3a-8d071487bcaa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:02.923639 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8a73578d-a845-4414-aa3a-8d071487bcaa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:02.924582 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8a73578d-a845-4414-aa3a-8d071487bcaa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:02.925774 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8a73578d-a845-4414-aa3a-8d071487bcaa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:02.926558 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8a73578d-a845-4414-aa3a-8d071487bcaa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:03.088289 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8a73578d-a845-4414-aa3a-8d071487bcaa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:03.097626 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8a73578d-a845-4414-aa3a-8d071487bcaa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1366 microversion: 2.1 time: 0.187501 Jul 18 10:53:03.098309 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 334/701] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:02 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:03.448242 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d73f03a7-f5a2-4793-b82d-7fd19bcc9ab6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:03.448863 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d73f03a7-f5a2-4793-b82d-7fd19bcc9ab6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:03.452024 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=10 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:03.453465 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:03.457944 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d73f03a7-f5a2-4793-b82d-7fd19bcc9ab6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:03.458386 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d73f03a7-f5a2-4793-b82d-7fd19bcc9ab6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:03.459261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d73f03a7-f5a2-4793-b82d-7fd19bcc9ab6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:03.459676 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d73f03a7-f5a2-4793-b82d-7fd19bcc9ab6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:03.494071 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d73f03a7-f5a2-4793-b82d-7fd19bcc9ab6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Going to try to terminate instance {{(pid=125007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:53:03.963859 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d73f03a7-f5a2-4793-b82d-7fd19bcc9ab6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "DELETE /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 204 len: 0 microversion: 2.1 time: 0.520339 Jul 18 10:53:03.964450 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 368/702] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:53:03 2022] DELETE /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:53:03.973194 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-db2716d2-c5d8-48f0-82b2-764678d5da2a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:03.973815 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-db2716d2-c5d8-48f0-82b2-764678d5da2a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:03.981215 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-db2716d2-c5d8-48f0-82b2-764678d5da2a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:03.981670 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-db2716d2-c5d8-48f0-82b2-764678d5da2a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:03.982443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-db2716d2-c5d8-48f0-82b2-764678d5da2a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:03.982920 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-db2716d2-c5d8-48f0-82b2-764678d5da2a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:04.121072 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3b766e26-5dd3-4b25-ac2f-b66dc4d1d6b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:04.121898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3b766e26-5dd3-4b25-ac2f-b66dc4d1d6b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:04.135135 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-db2716d2-c5d8-48f0-82b2-764678d5da2a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:04.139552 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3b766e26-5dd3-4b25-ac2f-b66dc4d1d6b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:04.140687 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3b766e26-5dd3-4b25-ac2f-b66dc4d1d6b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:04.144281 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-db2716d2-c5d8-48f0-82b2-764678d5da2a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1579 microversion: 2.1 time: 0.175164 Jul 18 10:53:04.155453 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 335/703] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:03 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:04.155599 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3b766e26-5dd3-4b25-ac2f-b66dc4d1d6b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:04.155599 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3b766e26-5dd3-4b25-ac2f-b66dc4d1d6b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:04.304502 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3b766e26-5dd3-4b25-ac2f-b66dc4d1d6b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:04.315383 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3b766e26-5dd3-4b25-ac2f-b66dc4d1d6b4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1366 microversion: 2.1 time: 0.202446 Jul 18 10:53:04.316110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 369/704] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:04 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:04.832896 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-4b6a9a22-51d5-47f4-94a7-63d78bbb7aff req-5d26ae97-24aa-408b-8fc1-b495c8427b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9faaf917-748f-4856-8100-c52e60ae0543", "name": "network-vif-plugged", "status": "completed", "tag": "c81718ab-c440-4c7c-acd6-9b66da2b719c"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:04.843611 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-4b6a9a22-51d5-47f4-94a7-63d78bbb7aff req-5d26ae97-24aa-408b-8fc1-b495c8427b83 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:04.844207 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-4b6a9a22-51d5-47f4-94a7-63d78bbb7aff req-5d26ae97-24aa-408b-8fc1-b495c8427b83 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:04.857694 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-4b6a9a22-51d5-47f4-94a7-63d78bbb7aff req-5d26ae97-24aa-408b-8fc1-b495c8427b83 service nova] Creating event network-vif-plugged:c81718ab-c440-4c7c-acd6-9b66da2b719c for instance 9faaf917-748f-4856-8100-c52e60ae0543 on hv-cinder-84949 Jul 18 10:53:04.863013 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-4b6a9a22-51d5-47f4-94a7-63d78bbb7aff req-5d26ae97-24aa-408b-8fc1-b495c8427b83 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100943 Jul 18 10:53:04.864244 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 336/705] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:05.163477 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-dbbb09c7-6aff-453e-93e1-deed376bd4b7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:05.164887 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-dbbb09c7-6aff-453e-93e1-deed376bd4b7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:05.171592 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dbbb09c7-6aff-453e-93e1-deed376bd4b7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:05.172039 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dbbb09c7-6aff-453e-93e1-deed376bd4b7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:05.172828 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dbbb09c7-6aff-453e-93e1-deed376bd4b7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:05.173261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dbbb09c7-6aff-453e-93e1-deed376bd4b7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:05.189191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:05.335416 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-47761bc7-c287-400b-a1e5-36a8fbe66b71 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:05.336421 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-47761bc7-c287-400b-a1e5-36a8fbe66b71 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:05.343531 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-47761bc7-c287-400b-a1e5-36a8fbe66b71 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:05.344001 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-47761bc7-c287-400b-a1e5-36a8fbe66b71 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:05.344876 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-47761bc7-c287-400b-a1e5-36a8fbe66b71 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:05.345559 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-47761bc7-c287-400b-a1e5-36a8fbe66b71 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:05.714145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-dbbb09c7-6aff-453e-93e1-deed376bd4b7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:05.723015 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-dbbb09c7-6aff-453e-93e1-deed376bd4b7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1579 microversion: 2.1 time: 0.563879 Jul 18 10:53:05.733209 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 370/706] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:05 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1579 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:05.934122 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-47761bc7-c287-400b-a1e5-36a8fbe66b71 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:05.948149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-47761bc7-c287-400b-a1e5-36a8fbe66b71 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1366 microversion: 2.1 time: 0.617167 Jul 18 10:53:05.950287 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 337/707] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:05 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1366 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:06.223100 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-da89d594-c459-4226-8483-ee3ade806c10 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:06.223593 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-da89d594-c459-4226-8483-ee3ade806c10 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:06.231034 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-da89d594-c459-4226-8483-ee3ade806c10 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:06.231482 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-da89d594-c459-4226-8483-ee3ade806c10 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:06.232362 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-da89d594-c459-4226-8483-ee3ade806c10 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:06.232765 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-da89d594-c459-4226-8483-ee3ade806c10 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:06.257720 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-da89d594-c459-4226-8483-ee3ade806c10 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d/ips" status: 200 len: 150 microversion: 2.20 time: 0.094573 Jul 18 10:53:06.258315 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 371/708] 10.222.0.49 () {60 vars in 1288 bytes} [Mon Jul 18 10:53:06 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d/ips => generated 150 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:53:06.751109 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-111d2868-e168-47c7-8106-9ed64ed92f8b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:06.754350 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-111d2868-e168-47c7-8106-9ed64ed92f8b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:06.757199 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-0fcaff8d-23b2-42d3-92f6-9763478945c1 req-f12d45c0-fdbc-4df0-9108-616a143efb7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309e30be-b4c2-4959-97f8-1ea7925c9e5c", "name": "network-vif-deleted", "tag": "d0664086-9234-4f4b-a1d4-a34f998954fe"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:06.763394 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-111d2868-e168-47c7-8106-9ed64ed92f8b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:06.768890 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-111d2868-e168-47c7-8106-9ed64ed92f8b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:06.768890 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-111d2868-e168-47c7-8106-9ed64ed92f8b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:06.768890 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-111d2868-e168-47c7-8106-9ed64ed92f8b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:06.777130 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-0fcaff8d-23b2-42d3-92f6-9763478945c1 req-f12d45c0-fdbc-4df0-9108-616a143efb7d service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:06.777789 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-0fcaff8d-23b2-42d3-92f6-9763478945c1 req-f12d45c0-fdbc-4df0-9108-616a143efb7d service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:06.790731 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-0fcaff8d-23b2-42d3-92f6-9763478945c1 req-f12d45c0-fdbc-4df0-9108-616a143efb7d service nova] Creating event network-vif-deleted:d0664086-9234-4f4b-a1d4-a34f998954fe for instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c on hv-cinder-84949 Jul 18 10:53:06.809730 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-0fcaff8d-23b2-42d3-92f6-9763478945c1 req-f12d45c0-fdbc-4df0-9108-616a143efb7d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043732 Jul 18 10:53:06.810669 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 372/709] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:06.877535 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-111d2868-e168-47c7-8106-9ed64ed92f8b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:06.903566 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-111d2868-e168-47c7-8106-9ed64ed92f8b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1511 microversion: 2.1 time: 0.165340 Jul 18 10:53:06.904145 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 338/710] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:06 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:06.970401 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0c6767f9-cd6b-420f-a547-ab34fa7f7aec tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:06.971108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-0c6767f9-cd6b-420f-a547-ab34fa7f7aec tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:06.978691 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0c6767f9-cd6b-420f-a547-ab34fa7f7aec tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:06.979384 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0c6767f9-cd6b-420f-a547-ab34fa7f7aec tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:06.980326 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0c6767f9-cd6b-420f-a547-ab34fa7f7aec tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:06.981037 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0c6767f9-cd6b-420f-a547-ab34fa7f7aec tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:07.205930 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-0c6767f9-cd6b-420f-a547-ab34fa7f7aec tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:07.218171 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-0c6767f9-cd6b-420f-a547-ab34fa7f7aec tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1366 microversion: 2.1 time: 0.254125 Jul 18 10:53:07.220638 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 373/711] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:06 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:07.922944 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-43e449ad-3eb3-4614-b4bd-d3ec661d7b6d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:07.923541 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-43e449ad-3eb3-4614-b4bd-d3ec661d7b6d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:07.931833 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-43e449ad-3eb3-4614-b4bd-d3ec661d7b6d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:07.932409 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-43e449ad-3eb3-4614-b4bd-d3ec661d7b6d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:07.933492 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-43e449ad-3eb3-4614-b4bd-d3ec661d7b6d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:07.934184 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-43e449ad-3eb3-4614-b4bd-d3ec661d7b6d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:08.024298 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-43e449ad-3eb3-4614-b4bd-d3ec661d7b6d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:08.041505 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-43e449ad-3eb3-4614-b4bd-d3ec661d7b6d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1226 microversion: 2.1 time: 0.117891 Jul 18 10:53:08.043212 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 339/712] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:07 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:08.238833 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e8b535cb-95d6-4e15-b0cc-1164e71b7c60 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:08.239465 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-e8b535cb-95d6-4e15-b0cc-1164e71b7c60 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:08.247646 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e8b535cb-95d6-4e15-b0cc-1164e71b7c60 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:08.248182 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e8b535cb-95d6-4e15-b0cc-1164e71b7c60 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:08.257283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e8b535cb-95d6-4e15-b0cc-1164e71b7c60 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:08.257283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e8b535cb-95d6-4e15-b0cc-1164e71b7c60 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:08.398746 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e8b535cb-95d6-4e15-b0cc-1164e71b7c60 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:08.406611 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e8b535cb-95d6-4e15-b0cc-1164e71b7c60 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1555 microversion: 2.1 time: 0.173411 Jul 18 10:53:08.407186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 374/713] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:08 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:08.424456 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5c408537-89e6-4dd1-bc73-a818f43ed733 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:08.424993 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5c408537-89e6-4dd1-bc73-a818f43ed733 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:08.431953 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c408537-89e6-4dd1-bc73-a818f43ed733 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:08.432408 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c408537-89e6-4dd1-bc73-a818f43ed733 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:08.433211 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c408537-89e6-4dd1-bc73-a818f43ed733 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:08.433648 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5c408537-89e6-4dd1-bc73-a818f43ed733 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:08.515340 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5c408537-89e6-4dd1-bc73-a818f43ed733 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094810 Jul 18 10:53:08.515938 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 340/714] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 18 10:53:08 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:08.732845 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ec09d2a6-7e1e-4ba6-84ab-dd473c0d29ff tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:08.733749 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ec09d2a6-7e1e-4ba6-84ab-dd473c0d29ff tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:08.740805 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ec09d2a6-7e1e-4ba6-84ab-dd473c0d29ff tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:08.741996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ec09d2a6-7e1e-4ba6-84ab-dd473c0d29ff tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:08.742954 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ec09d2a6-7e1e-4ba6-84ab-dd473c0d29ff tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:08.743383 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ec09d2a6-7e1e-4ba6-84ab-dd473c0d29ff tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:08.774034 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-ec09d2a6-7e1e-4ba6-84ab-dd473c0d29ff tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lazy-loading 'flavor' on Instance uuid 4f1b361f-a048-4231-8c87-b3b27c478f7d {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:53:08.926091 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bb9bd695-2973-4634-92d8-728dae05b8ea tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Action: 'create', calling method: .version_select at 0x7f6364cb50d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-827517469", "metadata": {"Type": "work"}}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bb9bd695-2973-4634-92d8-728dae05b8ea tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Request method failure captured: Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 121 Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1TuUxaJCRyWuW5NQSS6ayZNI6TW3s6a29gIDzyUVMz1lPsXeZ0Fohy31_kdiuwCxQoB9qWGDqjhL-8Ki9ckRBi3HjDSOlJ3XNz9WgTWz5h_xaDZiVjwn9VBsb2xfouCArdun8mpZY6OrR6lDzLQsXLjMkIutRMCFBRSB69Bue-IhWa4 Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 0d28a0aa7f02406f8af879023498292d Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:53:08.953544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:53:08.955443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0d28a0aa7f02406f8af879023498292d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:53:08.955443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:08.955443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 0d28a0aa7f02406f8af879023498292d Jul 18 10:53:08.955443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:08.955443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-VolumesNegativeTest-1665252389-project Jul 18 10:53:08.955443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:53:08.955443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:53:08.955443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 38403b569e9f41c7ba4864388b16e1c4 Jul 18 10:53:08.955443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-VolumesNegativeTest-1665252389-project Jul 18 10:53:08.955443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Jul 18 10:53:08.955443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-827517469", "metadata": {"Type": "work"}}} Jul 18 10:53:08.955443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: Jul 18 10:53:08.955443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-827517469', 'metadata': {'Type': 'work'}}}} Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise error Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi '#$%' Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:08.956400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 10:53:08.957974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 10:53:08.959209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 10:53:08.959209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.959209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bb9bd695-2973-4634-92d8-728dae05b8ea tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:08.959209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-bb9bd695-2973-4634-92d8-728dae05b8ea tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.194330 Jul 18 10:53:08.959209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 341/715] 10.222.0.49 () {60 vars in 1155 bytes} [Mon Jul 18 10:53:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:53:08.966369 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-253fd65e-4fe3-45da-92cf-0db5bd8e11a2 tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Action: 'create', calling method: .version_select at 0x7f6364d23af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-865733726", "metadata": {"Type": "work"}}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-253fd65e-4fe3-45da-92cf-0db5bd8e11a2 tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Request method failure captured: Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 119 Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1TuUxaJCRyWuW5NQSS6ayZNI6TW3s6a29gIDzyUVMz1lPsXeZ0Fohy31_kdiuwCxQoB9qWGDqjhL-8Ki9ckRBi3HjDSOlJ3XNz9WgTWz5h_xaDZiVjwn9VBsb2xfouCArdun8mpZY6OrR6lDzLQsXLjMkIutRMCFBRSB69Bue-IhWa4 Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 0d28a0aa7f02406f8af879023498292d Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:53:08.968977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:53:08.980525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0d28a0aa7f02406f8af879023498292d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:53:08.980525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:08.980525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 0d28a0aa7f02406f8af879023498292d Jul 18 10:53:08.980525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:08.980525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-VolumesNegativeTest-1665252389-project Jul 18 10:53:08.980525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:53:08.980525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:53:08.980525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 38403b569e9f41c7ba4864388b16e1c4 Jul 18 10:53:08.980525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-VolumesNegativeTest-1665252389-project Jul 18 10:53:08.980525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Jul 18 10:53:08.980525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-865733726", "metadata": {"Type": "work"}}} Jul 18 10:53:08.980525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: Jul 18 10:53:08.980525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-865733726', 'metadata': {'Type': 'work'}}}} Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise error Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi '0' Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:08.981447 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 10:53:08.983169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 10:53:08.984560 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 10:53:08.984560 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.984560 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-253fd65e-4fe3-45da-92cf-0db5bd8e11a2 tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:08.984560 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-253fd65e-4fe3-45da-92cf-0db5bd8e11a2 tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008088 Jul 18 10:53:08.984560 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 342/716] 10.222.0.49 () {60 vars in 1155 bytes} [Mon Jul 18 10:53:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 10:53:08.990246 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7ef54dd2-7335-4617-bb27-5393419482d2 tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Action: 'create', calling method: .version_select at 0x7f6364e0aee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1774534628", "metadata": {"Type": "work"}}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7ef54dd2-7335-4617-bb27-5393419482d2 tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Request method failure captured: Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 119 Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1TuUxaJCRyWuW5NQSS6ayZNI6TW3s6a29gIDzyUVMz1lPsXeZ0Fohy31_kdiuwCxQoB9qWGDqjhL-8Ki9ckRBi3HjDSOlJ3XNz9WgTWz5h_xaDZiVjwn9VBsb2xfouCArdun8mpZY6OrR6lDzLQsXLjMkIutRMCFBRSB69Bue-IhWa4 Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 0d28a0aa7f02406f8af879023498292d Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:53:08.993470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:53:08.995543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0d28a0aa7f02406f8af879023498292d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:53:08.995543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:08.995543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 0d28a0aa7f02406f8af879023498292d Jul 18 10:53:08.995543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:08.995543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-VolumesNegativeTest-1665252389-project Jul 18 10:53:08.995543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:53:08.995543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:53:08.995543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 38403b569e9f41c7ba4864388b16e1c4 Jul 18 10:53:08.995543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-VolumesNegativeTest-1665252389-project Jul 18 10:53:08.995543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Jul 18 10:53:08.995543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1774534628", "metadata": {"Type": "work"}}} Jul 18 10:53:08.995543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: Jul 18 10:53:08.995543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1774534628', 'metadata': {'Type': 'work'}}}} Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise error Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi '' Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:08.997982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 10:53:09.001070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 10:53:09.008439 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 10:53:09.008439 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.008439 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7ef54dd2-7335-4617-bb27-5393419482d2 tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:09.008439 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7ef54dd2-7335-4617-bb27-5393419482d2 tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013664 Jul 18 10:53:09.008439 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 343/717] 10.222.0.49 () {60 vars in 1155 bytes} [Mon Jul 18 10:53:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:53:09.008439 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-653b4582-fdf0-4026-b0ed-c3211aa73602 tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Calling method '.version_select at 0x7f6364e5a310>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:09.035468 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-653b4582-fdf0-4026-b0ed-c3211aa73602 tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] HTTP exception thrown: Volume tempest-invalid-2009029069 could not be found. Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-653b4582-fdf0-4026-b0ed-c3211aa73602 tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Request method failure captured: Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2009029069 HTTP/1.1 Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1TuUxaJCRyWuW5NQSS6ayZNI6TW3s6a29gIDzyUVMz1lPsXeZ0Fohy31_kdiuwCxQoB9qWGDqjhL-8Ki9ckRBi3HjDSOlJ3XNz9WgTWz5h_xaDZiVjwn9VBsb2xfouCArdun8mpZY6OrR6lDzLQsXLjMkIutRMCFBRSB69Bue-IhWa4 Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 0d28a0aa7f02406f8af879023498292d Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:53:09.039084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:53:09.040512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0d28a0aa7f02406f8af879023498292d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:53:09.040512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:09.040512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 0d28a0aa7f02406f8af879023498292d Jul 18 10:53:09.040512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:09.040512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-VolumesNegativeTest-1665252389-project Jul 18 10:53:09.040512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:53:09.040512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:53:09.040512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 38403b569e9f41c7ba4864388b16e1c4 Jul 18 10:53:09.040512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-VolumesNegativeTest-1665252389-project Jul 18 10:53:09.040512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: Jul 18 10:53:09.040512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Volume tempest-invalid-2009029069 could not be found. Jul 18 10:53:09.040512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': 'tempest-invalid-2009029069'} Jul 18 10:53:09.040512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2009029069 could not be found. (HTTP 404) (Request-ID: req-210f9a10-2cd7-4966-afc5-823fe4691faf) Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:09.041353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:53:09.042488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2009029069 could not be found. Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:53:09.043672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2009029069 could not be found. Jul 18 10:53:09.045316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.045316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:09.045316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.045316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:09.045316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:09.045316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:09.045316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:53:09.045316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:53:09.045316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2009029069 could not be found. Jul 18 10:53:09.045316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.045316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-653b4582-fdf0-4026-b0ed-c3211aa73602 tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Returning 404 to user: Volume tempest-invalid-2009029069 could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:09.045316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-653b4582-fdf0-4026-b0ed-c3211aa73602 tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2009029069" status: 404 len: 99 microversion: 2.1 time: 0.039339 Jul 18 10:53:09.045316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 344/718] 10.222.0.49 () {58 vars in 1217 bytes} [Mon Jul 18 10:53:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2009029069 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 18 10:53:09.051755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-17936be2-0464-4080-80d1-534c0cbddccc tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005102 Jul 18 10:53:09.052503 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 345/719] 10.222.0.49 () {58 vars in 1139 bytes} [Mon Jul 18 10:53:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 18 10:53:09.061861 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-474037d8-7947-4c33-8a04-23d600f7c98a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:09.062468 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-474037d8-7947-4c33-8a04-23d600f7c98a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:09.068767 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-474037d8-7947-4c33-8a04-23d600f7c98a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:09.069400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-474037d8-7947-4c33-8a04-23d600f7c98a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:09.070158 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-474037d8-7947-4c33-8a04-23d600f7c98a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:09.070577 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-474037d8-7947-4c33-8a04-23d600f7c98a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:09.106682 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-474037d8-7947-4c33-8a04-23d600f7c98a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:09.107128 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-474037d8-7947-4c33-8a04-23d600f7c98a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:09.107765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-474037d8-7947-4c33-8a04-23d600f7c98a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lazy-loading 'fault' on Instance uuid 309e30be-b4c2-4959-97f8-1ea7925c9e5c {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:53:09.157978 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-474037d8-7947-4c33-8a04-23d600f7c98a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:09.167184 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-474037d8-7947-4c33-8a04-23d600f7c98a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 200 len: 1231 microversion: 2.1 time: 0.108815 Jul 18 10:53:09.167645 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 346/720] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:09 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 1231 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:09.172797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-cdd384f9-e894-45ff-8be9-50550a85bc44 tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003959 Jul 18 10:53:09.173331 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 347/721] 10.222.0.49 () {58 vars in 1136 bytes} [Mon Jul 18 10:53:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 10:53:09.184070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-ebd19254-57f9-46a3-91ee-7d54699a908a tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Calling method '.version_select at 0x7f6364cb5820>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:09.219754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-ebd19254-57f9-46a3-91ee-7d54699a908a tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] HTTP exception thrown: Volume 18bf204a-7fa5-4893-bc7f-9e5f46fbdd30 could not be found. Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-ebd19254-57f9-46a3-91ee-7d54699a908a tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Request method failure captured: Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: DELETE /compute/v2.1/os-volumes/18bf204a-7fa5-4893-bc7f-9e5f46fbdd30 HTTP/1.1 Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1TuUxaJCRyWuW5NQSS6ayZNI6TW3s6a29gIDzyUVMz1lPsXeZ0Fohy31_kdiuwCxQoB9qWGDqjhL-8Ki9ckRBi3HjDSOlJ3XNz9WgTWz5h_xaDZiVjwn9VBsb2xfouCArdun8mpZY6OrR6lDzLQsXLjMkIutRMCFBRSB69Bue-IhWa4 Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 0d28a0aa7f02406f8af879023498292d Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:53:09.221797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:53:09.223299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0d28a0aa7f02406f8af879023498292d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:53:09.223299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:09.223299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 0d28a0aa7f02406f8af879023498292d Jul 18 10:53:09.223299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:09.223299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-VolumesNegativeTest-1665252389-project Jul 18 10:53:09.223299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:53:09.223299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:53:09.223299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 38403b569e9f41c7ba4864388b16e1c4 Jul 18 10:53:09.223299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-VolumesNegativeTest-1665252389-project Jul 18 10:53:09.223299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: Jul 18 10:53:09.223299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Volume 18bf204a-7fa5-4893-bc7f-9e5f46fbdd30 could not be found. Jul 18 10:53:09.223299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '18bf204a-7fa5-4893-bc7f-9e5f46fbdd30'} Jul 18 10:53:09.223299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18bf204a-7fa5-4893-bc7f-9e5f46fbdd30 could not be found. (HTTP 404) (Request-ID: req-bb3a7635-1e12-43c0-876a-7b5ba2f8a54b) Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:09.226022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:53:09.227264 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18bf204a-7fa5-4893-bc7f-9e5f46fbdd30 could not be found. Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 10:53:09.228336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:53:09.229510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18bf204a-7fa5-4893-bc7f-9e5f46fbdd30 could not be found. Jul 18 10:53:09.229510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.229510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:09.229510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.229510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:09.229510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:09.229510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:09.229510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:53:09.229510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:53:09.229510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18bf204a-7fa5-4893-bc7f-9e5f46fbdd30 could not be found. Jul 18 10:53:09.229510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.229510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-ebd19254-57f9-46a3-91ee-7d54699a908a tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Returning 404 to user: Volume 18bf204a-7fa5-4893-bc7f-9e5f46fbdd30 could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:09.229510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-ebd19254-57f9-46a3-91ee-7d54699a908a tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/18bf204a-7fa5-4893-bc7f-9e5f46fbdd30" status: 404 len: 109 microversion: 2.1 time: 0.043383 Jul 18 10:53:09.229510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 348/722] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 18 10:53:09 2022] DELETE /compute/v2.1/os-volumes/18bf204a-7fa5-4893-bc7f-9e5f46fbdd30 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:53:09.234929 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-636a1a42-fff1-44b4-b174-3c8ab9906d8d tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Calling method '.version_select at 0x7f6364c0a160>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:09.272557 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-636a1a42-fff1-44b4-b174-3c8ab9906d8d tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] HTTP exception thrown: Volume a61f0248-0b39-4eca-a3bd-bfe87866c932 could not be found. Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-636a1a42-fff1-44b4-b174-3c8ab9906d8d tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Request method failure captured: Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: GET /compute/v2.1/os-volumes/a61f0248-0b39-4eca-a3bd-bfe87866c932 HTTP/1.1 Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1TuUxaJCRyWuW5NQSS6ayZNI6TW3s6a29gIDzyUVMz1lPsXeZ0Fohy31_kdiuwCxQoB9qWGDqjhL-8Ki9ckRBi3HjDSOlJ3XNz9WgTWz5h_xaDZiVjwn9VBsb2xfouCArdun8mpZY6OrR6lDzLQsXLjMkIutRMCFBRSB69Bue-IhWa4 Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 0d28a0aa7f02406f8af879023498292d Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:53:09.274622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:53:09.276085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0d28a0aa7f02406f8af879023498292d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0d28a0aa7f02406f8af879023498292d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:53:09.276085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:09.276085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 0d28a0aa7f02406f8af879023498292d Jul 18 10:53:09.276085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-VolumesNegativeTest-1665252389 Jul 18 10:53:09.276085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-VolumesNegativeTest-1665252389-project Jul 18 10:53:09.276085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:53:09.276085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:53:09.276085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 38403b569e9f41c7ba4864388b16e1c4 Jul 18 10:53:09.276085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-VolumesNegativeTest-1665252389-project Jul 18 10:53:09.276085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: Jul 18 10:53:09.276085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Volume a61f0248-0b39-4eca-a3bd-bfe87866c932 could not be found. Jul 18 10:53:09.276085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': 'a61f0248-0b39-4eca-a3bd-bfe87866c932'} Jul 18 10:53:09.276085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a61f0248-0b39-4eca-a3bd-bfe87866c932 could not be found. (HTTP 404) (Request-ID: req-75820398-bbea-495c-9045-bc17353b2d3e) Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:09.281598 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:53:09.282789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a61f0248-0b39-4eca-a3bd-bfe87866c932 could not be found. Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 10:53:09.283917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:53:09.286248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a61f0248-0b39-4eca-a3bd-bfe87866c932 could not be found. Jul 18 10:53:09.286248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.286248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:09.286248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.286248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:09.286248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:09.286248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:09.286248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:53:09.286248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:53:09.286248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a61f0248-0b39-4eca-a3bd-bfe87866c932 could not be found. Jul 18 10:53:09.286248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:53:09.286248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-636a1a42-fff1-44b4-b174-3c8ab9906d8d tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] Returning 404 to user: Volume a61f0248-0b39-4eca-a3bd-bfe87866c932 could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:09.286248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-636a1a42-fff1-44b4-b174-3c8ab9906d8d tempest-VolumesNegativeTest-1665252389 tempest-VolumesNegativeTest-1665252389-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/a61f0248-0b39-4eca-a3bd-bfe87866c932" status: 404 len: 109 microversion: 2.1 time: 0.045643 Jul 18 10:53:09.286248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 349/723] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:53:09 2022] GET /compute/v2.1/os-volumes/a61f0248-0b39-4eca-a3bd-bfe87866c932 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:53:09.473297 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a5327eab-982f-4d14-a7b7-3f4a0ecb6baa tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:09.474293 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a5327eab-982f-4d14-a7b7-3f4a0ecb6baa tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:09.482610 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a5327eab-982f-4d14-a7b7-3f4a0ecb6baa tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:09.483095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a5327eab-982f-4d14-a7b7-3f4a0ecb6baa tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:09.483989 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a5327eab-982f-4d14-a7b7-3f4a0ecb6baa tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:09.484436 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a5327eab-982f-4d14-a7b7-3f4a0ecb6baa tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:09.517681 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a5327eab-982f-4d14-a7b7-3f4a0ecb6baa tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048447 Jul 18 10:53:09.518248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 350/724] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:53:09 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:53:09.530269 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f9542d84-86e0-4dbb-8ce8-d964fdb5e18c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:09.531235 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f9542d84-86e0-4dbb-8ce8-d964fdb5e18c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:09.535001 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ec09d2a6-7e1e-4ba6-84ab-dd473c0d29ff tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "POST /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d/action" status: 202 len: 0 microversion: 2.20 time: 0.806014 Jul 18 10:53:09.539779 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 375/725] 10.222.0.49 () {62 vars in 1318 bytes} [Mon Jul 18 10:53:08 2022] POST /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d/action => generated 0 bytes in 808 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 10:53:09.547475 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-da8e7c58-6f55-43ea-bd17-d11f2819bbda tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:09.547721 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-da8e7c58-6f55-43ea-bd17-d11f2819bbda tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:09.548934 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f9542d84-86e0-4dbb-8ce8-d964fdb5e18c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:09.553702 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f9542d84-86e0-4dbb-8ce8-d964fdb5e18c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:09.554883 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f9542d84-86e0-4dbb-8ce8-d964fdb5e18c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:09.555400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f9542d84-86e0-4dbb-8ce8-d964fdb5e18c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:09.560593 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-da8e7c58-6f55-43ea-bd17-d11f2819bbda tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:09.562546 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-da8e7c58-6f55-43ea-bd17-d11f2819bbda tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:09.562546 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-da8e7c58-6f55-43ea-bd17-d11f2819bbda tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:09.562916 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-da8e7c58-6f55-43ea-bd17-d11f2819bbda tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:09.596305 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f9542d84-86e0-4dbb-8ce8-d964fdb5e18c tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments/76746fa1-3296-4b90-8925-970b76790e41" status: 200 len: 194 microversion: 2.1 time: 0.070918 Jul 18 10:53:09.597108 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 351/726] 10.222.0.49 () {58 vars in 1412 bytes} [Mon Jul 18 10:53:09 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments/76746fa1-3296-4b90-8925-970b76790e41 => generated 194 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:53:09.801782 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-da8e7c58-6f55-43ea-bd17-d11f2819bbda tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:09.818082 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-da8e7c58-6f55-43ea-bd17-d11f2819bbda tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:09.820174 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-da8e7c58-6f55-43ea-bd17-d11f2819bbda tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:09.821596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-da8e7c58-6f55-43ea-bd17-d11f2819bbda tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1722 microversion: 2.20 time: 0.279081 Jul 18 10:53:09.822351 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 376/727] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:09 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:09.853743 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-72d2dbbf-b2ff-4b70-97e6-54edd31a45aa req-c21a3160-cf9c-43cd-bc85-93358a2e81b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9faaf917-748f-4856-8100-c52e60ae0543", "tag": "c81718ab-c440-4c7c-acd6-9b66da2b719c"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:09.864485 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-72d2dbbf-b2ff-4b70-97e6-54edd31a45aa req-c21a3160-cf9c-43cd-bc85-93358a2e81b9 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:09.865131 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-72d2dbbf-b2ff-4b70-97e6-54edd31a45aa req-c21a3160-cf9c-43cd-bc85-93358a2e81b9 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:09.883950 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-72d2dbbf-b2ff-4b70-97e6-54edd31a45aa req-c21a3160-cf9c-43cd-bc85-93358a2e81b9 service nova] Creating event network-changed:c81718ab-c440-4c7c-acd6-9b66da2b719c for instance 9faaf917-748f-4856-8100-c52e60ae0543 on hv-cinder-84949 Jul 18 10:53:09.893301 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-72d2dbbf-b2ff-4b70-97e6-54edd31a45aa req-c21a3160-cf9c-43cd-bc85-93358a2e81b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043099 Jul 18 10:53:09.894954 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 352/728] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:10.185858 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-aa353758-3686-4db7-817f-287e8fe73995 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:10.186681 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-aa353758-3686-4db7-817f-287e8fe73995 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:10.196189 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-aa353758-3686-4db7-817f-287e8fe73995 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:10.206885 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-aa353758-3686-4db7-817f-287e8fe73995 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:10.206885 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-aa353758-3686-4db7-817f-287e8fe73995 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:10.206885 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-aa353758-3686-4db7-817f-287e8fe73995 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:10.218228 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-aa353758-3686-4db7-817f-287e8fe73995 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] HTTP exception thrown: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-aa353758-3686-4db7-817f-287e8fe73995 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Request method failure captured: Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c HTTP/1.1 Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1Tq9mlAHK0ystMhjyDb0YyO8U2hK7gGU1fUhDRpNQDWPyz-rISX1S04lsJPqJLD5MjfYJBjOs8RlHr0wD6AJXubnX1mFbTfY8w7JMXJAbxIlkuXby8pM0wO-ulmU3SBPUTAYPBrSsx5HpuARfVCkkhZFj-KX7C7-wHeLOUnh1eAJWYY Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 17f436162f3a4bd4b3a94f584e7d8782 Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-TestVolumeBootPattern-497016436 Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:53:10.221067 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:53:10.222768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:53:10.222768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-TestVolumeBootPattern-497016436 Jul 18 10:53:10.222768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 17f436162f3a4bd4b3a94f584e7d8782 Jul 18 10:53:10.222768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-TestVolumeBootPattern-497016436 Jul 18 10:53:10.222768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-TestVolumeBootPattern-497016436-project Jul 18 10:53:10.222768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:53:10.222768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:53:10.222768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: eb483b1aee944da8910dd7468a0ef4ac Jul 18 10:53:10.222768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-TestVolumeBootPattern-497016436-project Jul 18 10:53:10.222768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:53:10.222768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. Jul 18 10:53:10.222768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '309e30be-b4c2-4959-97f8-1ea7925c9e5c'} Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:10.223672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. Jul 18 10:53:10.225288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:10.231355 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-aa353758-3686-4db7-817f-287e8fe73995 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Returning 404 to user: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:10.233188 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-aa353758-3686-4db7-817f-287e8fe73995 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 404 len: 111 microversion: 2.1 time: 0.051804 Jul 18 10:53:10.234700 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 377/729] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:10 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:53:10.349391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2145070706", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1612637408", "security_groups": [{"name": "tempest-secgroup-smoke-1718855347"}], "block_device_mapping_v2": [{"uuid": "202895e8-5a9b-4dec-84bf-3e534f8ca5fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "407e895d-8435-43cb-addb-b40e755d1f02"}]}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:10.497210 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.network.neutron [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] validate_networks() for [('407e895d-8435-43cb-addb-b40e755d1f02', None, None, None, None, None)] {{(pid=125005) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:53:10.841819 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-dcfb7573-58ae-4e4a-80ab-ea07493e8832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:10.843615 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-dcfb7573-58ae-4e4a-80ab-ea07493e8832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:10.855010 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dcfb7573-58ae-4e4a-80ab-ea07493e8832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:10.855631 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dcfb7573-58ae-4e4a-80ab-ea07493e8832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:10.857464 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dcfb7573-58ae-4e4a-80ab-ea07493e8832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:10.858124 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dcfb7573-58ae-4e4a-80ab-ea07493e8832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:11.105644 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-dcfb7573-58ae-4e4a-80ab-ea07493e8832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:11.114559 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-dcfb7573-58ae-4e4a-80ab-ea07493e8832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:11.116974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-dcfb7573-58ae-4e4a-80ab-ea07493e8832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:11.118740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-dcfb7573-58ae-4e4a-80ab-ea07493e8832 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1722 microversion: 2.20 time: 0.281986 Jul 18 10:53:11.119300 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 378/730] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:10 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:11.207046 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Flavor limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:53:11.207046 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Image limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:53:11.207046 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Flavor pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:53:11.207046 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Image pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:53:11.210709 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:53:11.236814 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:11.237706 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:11.239301 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:11.242041 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:11.268963 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Getting quotas for project 17f436162f3a4bd4b3a94f584e7d8782. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:53:11.273618 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Getting quotas for user eb483b1aee944da8910dd7468a0ef4ac and project 17f436162f3a4bd4b3a94f584e7d8782. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:53:11.340446 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Going to run 1 instances... {{(pid=125005) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:53:11.343617 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='202895e8-5a9b-4dec-84bf-3e534f8ca5fd',volume_size=None,volume_type=None)] {{(pid=125005) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:53:11.602113 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2a1de059-807e-4e2f-b583-ccce08a69e41 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25a10f4b-b1cf-4ffe-9ab3-907d617cecc7"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:11.603265 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2a1de059-807e-4e2f-b583-ccce08a69e41 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:11.609818 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2a1de059-807e-4e2f-b583-ccce08a69e41 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:11.610275 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2a1de059-807e-4e2f-b583-ccce08a69e41 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:11.611074 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2a1de059-807e-4e2f-b583-ccce08a69e41 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:11.611515 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2a1de059-807e-4e2f-b583-ccce08a69e41 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:12.108763 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8495211c-b5af-4b46-b06a-b8ca236609a9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.764196 Jul 18 10:53:12.109491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 353/731] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:53:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 10:53:12.125991 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e0431b6a-ac81-4e64-9b13-48ec8e6efc2e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:12.126615 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e0431b6a-ac81-4e64-9b13-48ec8e6efc2e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:12.185068 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e0431b6a-ac81-4e64-9b13-48ec8e6efc2e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:12.191640 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e0431b6a-ac81-4e64-9b13-48ec8e6efc2e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1095 microversion: 2.1 time: 0.076120 Jul 18 10:53:12.192234 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 354/732] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:12 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:12.197728 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e00e97ae-014c-42b5-a4eb-2ba68a536da1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:12.198329 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e00e97ae-014c-42b5-a4eb-2ba68a536da1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:12.206191 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e00e97ae-014c-42b5-a4eb-2ba68a536da1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:12.206191 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e00e97ae-014c-42b5-a4eb-2ba68a536da1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:12.206399 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e00e97ae-014c-42b5-a4eb-2ba68a536da1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:12.206699 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e00e97ae-014c-42b5-a4eb-2ba68a536da1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:12.346550 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e00e97ae-014c-42b5-a4eb-2ba68a536da1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:12.355159 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e00e97ae-014c-42b5-a4eb-2ba68a536da1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:12.356659 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e00e97ae-014c-42b5-a4eb-2ba68a536da1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:12.357843 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e00e97ae-014c-42b5-a4eb-2ba68a536da1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1722 microversion: 2.20 time: 0.164728 Jul 18 10:53:12.358404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 355/733] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:12 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:12.991209 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2a1de059-807e-4e2f-b583-ccce08a69e41 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "POST /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.393187 Jul 18 10:53:13.003414 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 379/734] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 18 10:53:11 2022] POST /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments => generated 194 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:53:13.209145 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7841556a-d540-4966-9d07-68ce53567736 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:13.210688 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-7841556a-d540-4966-9d07-68ce53567736 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:13.271752 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7841556a-d540-4966-9d07-68ce53567736 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:13.279398 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7841556a-d540-4966-9d07-68ce53567736 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1095 microversion: 2.1 time: 0.074195 Jul 18 10:53:13.279958 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 356/735] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:13 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:13.383880 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d2045e4c-0a19-4729-8161-1b5f4c92fc89 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:13.383880 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d2045e4c-0a19-4729-8161-1b5f4c92fc89 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:13.386533 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d2045e4c-0a19-4729-8161-1b5f4c92fc89 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:13.386985 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d2045e4c-0a19-4729-8161-1b5f4c92fc89 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:13.387761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d2045e4c-0a19-4729-8161-1b5f4c92fc89 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:13.388196 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d2045e4c-0a19-4729-8161-1b5f4c92fc89 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:13.534465 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d2045e4c-0a19-4729-8161-1b5f4c92fc89 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:13.534465 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d2045e4c-0a19-4729-8161-1b5f4c92fc89 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:13.535511 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d2045e4c-0a19-4729-8161-1b5f4c92fc89 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:13.536604 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d2045e4c-0a19-4729-8161-1b5f4c92fc89 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1722 microversion: 2.20 time: 0.162201 Jul 18 10:53:13.537439 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 380/736] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:13 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:14.297724 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e60ce644-4c2d-45ae-94f1-3c0c8b57ae3a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:14.298381 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e60ce644-4c2d-45ae-94f1-3c0c8b57ae3a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:14.307057 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e60ce644-4c2d-45ae-94f1-3c0c8b57ae3a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:14.307502 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e60ce644-4c2d-45ae-94f1-3c0c8b57ae3a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:14.308267 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e60ce644-4c2d-45ae-94f1-3c0c8b57ae3a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:14.308694 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e60ce644-4c2d-45ae-94f1-3c0c8b57ae3a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:14.371951 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e60ce644-4c2d-45ae-94f1-3c0c8b57ae3a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:14.379596 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e60ce644-4c2d-45ae-94f1-3c0c8b57ae3a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1193 microversion: 2.1 time: 0.085769 Jul 18 10:53:14.380154 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 357/737] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:14 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:14.555681 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4108f1f2-63d7-4ef3-8396-501a56fc5b35 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:14.556292 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-4108f1f2-63d7-4ef3-8396-501a56fc5b35 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:14.563119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4108f1f2-63d7-4ef3-8396-501a56fc5b35 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:14.563638 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4108f1f2-63d7-4ef3-8396-501a56fc5b35 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:14.564411 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4108f1f2-63d7-4ef3-8396-501a56fc5b35 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:14.564866 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4108f1f2-63d7-4ef3-8396-501a56fc5b35 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:14.704456 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-4108f1f2-63d7-4ef3-8396-501a56fc5b35 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:14.713787 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-4108f1f2-63d7-4ef3-8396-501a56fc5b35 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:14.715299 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-4108f1f2-63d7-4ef3-8396-501a56fc5b35 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:14.716719 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4108f1f2-63d7-4ef3-8396-501a56fc5b35 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1722 microversion: 2.20 time: 0.165033 Jul 18 10:53:14.717296 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 381/738] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:14 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:15.396869 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-135492d6-c09b-46b1-beaa-4a99c0886f76 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:15.397751 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-135492d6-c09b-46b1-beaa-4a99c0886f76 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:15.404406 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-135492d6-c09b-46b1-beaa-4a99c0886f76 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:15.404895 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-135492d6-c09b-46b1-beaa-4a99c0886f76 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:15.405637 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-135492d6-c09b-46b1-beaa-4a99c0886f76 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:15.406062 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-135492d6-c09b-46b1-beaa-4a99c0886f76 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:15.474204 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-135492d6-c09b-46b1-beaa-4a99c0886f76 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:15.482030 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-135492d6-c09b-46b1-beaa-4a99c0886f76 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1211 microversion: 2.1 time: 0.089046 Jul 18 10:53:15.482639 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 358/739] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:15 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:15.735890 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ba325295-63e8-4b79-952f-2d7e2a383624 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:15.736765 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ba325295-63e8-4b79-952f-2d7e2a383624 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:15.744226 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ba325295-63e8-4b79-952f-2d7e2a383624 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:15.744676 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ba325295-63e8-4b79-952f-2d7e2a383624 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:15.745836 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ba325295-63e8-4b79-952f-2d7e2a383624 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:15.746122 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ba325295-63e8-4b79-952f-2d7e2a383624 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:16.126240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ba325295-63e8-4b79-952f-2d7e2a383624 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:16.139619 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ba325295-63e8-4b79-952f-2d7e2a383624 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:16.141219 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ba325295-63e8-4b79-952f-2d7e2a383624 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:16.142685 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ba325295-63e8-4b79-952f-2d7e2a383624 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1722 microversion: 2.20 time: 0.410913 Jul 18 10:53:16.158043 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 382/740] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:15 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1722 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:16.506549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-eeb36bf8-00bd-4be8-b357-c7e6ba718799 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:16.507175 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-eeb36bf8-00bd-4be8-b357-c7e6ba718799 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:16.514236 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-eeb36bf8-00bd-4be8-b357-c7e6ba718799 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:16.514699 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-eeb36bf8-00bd-4be8-b357-c7e6ba718799 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:16.515513 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-eeb36bf8-00bd-4be8-b357-c7e6ba718799 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:16.515955 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-eeb36bf8-00bd-4be8-b357-c7e6ba718799 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:16.665377 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-eeb36bf8-00bd-4be8-b357-c7e6ba718799 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:16.667748 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=100 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:16.673901 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-eeb36bf8-00bd-4be8-b357-c7e6ba718799 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1279 microversion: 2.1 time: 0.171438 Jul 18 10:53:16.674478 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 359/741] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:16 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:17.162195 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-87a052ed-3c1b-4d42-ac0d-62a52a0a6d77 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:17.163542 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-87a052ed-3c1b-4d42-ac0d-62a52a0a6d77 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:17.169593 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87a052ed-3c1b-4d42-ac0d-62a52a0a6d77 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:17.170039 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87a052ed-3c1b-4d42-ac0d-62a52a0a6d77 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:17.170803 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87a052ed-3c1b-4d42-ac0d-62a52a0a6d77 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:17.171236 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87a052ed-3c1b-4d42-ac0d-62a52a0a6d77 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:17.237048 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-fce84096-9b52-497d-8c35-d558f81ad51a req-1dfe94c0-acd6-4ef3-81dd-0cbfc122efd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e75fba7-e72d-4479-ab36-0bbf9f294d22", "tag": "42168f45-7a03-471a-b163-85fef4b32faa"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:17.250499 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-fce84096-9b52-497d-8c35-d558f81ad51a req-1dfe94c0-acd6-4ef3-81dd-0cbfc122efd1 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:17.251652 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-fce84096-9b52-497d-8c35-d558f81ad51a req-1dfe94c0-acd6-4ef3-81dd-0cbfc122efd1 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:17.267096 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-fce84096-9b52-497d-8c35-d558f81ad51a req-1dfe94c0-acd6-4ef3-81dd-0cbfc122efd1 service nova] Creating event network-changed:42168f45-7a03-471a-b163-85fef4b32faa for instance 6e75fba7-e72d-4479-ab36-0bbf9f294d22 on hv-cinder-84949 Jul 18 10:53:17.272732 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-fce84096-9b52-497d-8c35-d558f81ad51a req-1dfe94c0-acd6-4ef3-81dd-0cbfc122efd1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044612 Jul 18 10:53:17.273596 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 360/742] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:53:17.369790 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-87a052ed-3c1b-4d42-ac0d-62a52a0a6d77 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:17.385456 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-87a052ed-3c1b-4d42-ac0d-62a52a0a6d77 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:17.391301 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-87a052ed-3c1b-4d42-ac0d-62a52a0a6d77 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:17.391301 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-87a052ed-3c1b-4d42-ac0d-62a52a0a6d77 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1722 microversion: 2.20 time: 0.230472 Jul 18 10:53:17.391301 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 383/743] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:17 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:17.692831 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-93020837-7486-4a0f-927e-bc086a15389c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:17.697308 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-93020837-7486-4a0f-927e-bc086a15389c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:17.702773 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-93020837-7486-4a0f-927e-bc086a15389c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:17.703512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-93020837-7486-4a0f-927e-bc086a15389c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:17.704737 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-93020837-7486-4a0f-927e-bc086a15389c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:17.705235 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-93020837-7486-4a0f-927e-bc086a15389c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:17.882741 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-93020837-7486-4a0f-927e-bc086a15389c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:17.891246 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-93020837-7486-4a0f-927e-bc086a15389c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1279 microversion: 2.1 time: 0.203388 Jul 18 10:53:17.891953 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 361/744] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:17 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1279 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:18.410666 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-c19f0393-5a6c-4510-9c0e-0b5b2407b542 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:18.411433 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-c19f0393-5a6c-4510-9c0e-0b5b2407b542 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:18.418739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c19f0393-5a6c-4510-9c0e-0b5b2407b542 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:18.419286 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c19f0393-5a6c-4510-9c0e-0b5b2407b542 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:18.420282 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c19f0393-5a6c-4510-9c0e-0b5b2407b542 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:18.420879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c19f0393-5a6c-4510-9c0e-0b5b2407b542 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:18.561214 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c19f0393-5a6c-4510-9c0e-0b5b2407b542 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:18.570078 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c19f0393-5a6c-4510-9c0e-0b5b2407b542 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:18.571558 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c19f0393-5a6c-4510-9c0e-0b5b2407b542 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:18.572884 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-c19f0393-5a6c-4510-9c0e-0b5b2407b542 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1722 microversion: 2.20 time: 0.167053 Jul 18 10:53:18.579911 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 384/745] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:18 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:18.908610 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-fdb4a93b-68a0-4b99-b5dc-e96d71a2d03e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:18.909358 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-fdb4a93b-68a0-4b99-b5dc-e96d71a2d03e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:18.916747 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fdb4a93b-68a0-4b99-b5dc-e96d71a2d03e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:18.917030 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fdb4a93b-68a0-4b99-b5dc-e96d71a2d03e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:18.917802 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fdb4a93b-68a0-4b99-b5dc-e96d71a2d03e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:18.918228 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fdb4a93b-68a0-4b99-b5dc-e96d71a2d03e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:19.062005 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-fdb4a93b-68a0-4b99-b5dc-e96d71a2d03e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:19.071206 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-fdb4a93b-68a0-4b99-b5dc-e96d71a2d03e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1279 microversion: 2.1 time: 0.166341 Jul 18 10:53:19.071754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 362/746] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:18 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1279 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:19.591740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-c6140ad7-135a-4ec8-bd03-774151bcd074 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:19.592438 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-c6140ad7-135a-4ec8-bd03-774151bcd074 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:19.599675 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c6140ad7-135a-4ec8-bd03-774151bcd074 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:19.600743 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c6140ad7-135a-4ec8-bd03-774151bcd074 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:19.602349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c6140ad7-135a-4ec8-bd03-774151bcd074 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:19.602817 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c6140ad7-135a-4ec8-bd03-774151bcd074 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:19.621327 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:19.749350 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c6140ad7-135a-4ec8-bd03-774151bcd074 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:19.758101 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c6140ad7-135a-4ec8-bd03-774151bcd074 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:19.759627 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c6140ad7-135a-4ec8-bd03-774151bcd074 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:19.760889 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-c6140ad7-135a-4ec8-bd03-774151bcd074 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1722 microversion: 2.20 time: 0.173208 Jul 18 10:53:19.764671 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 385/747] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:19 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:20.087874 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-25172bcb-5f4d-4717-8af9-b10a7ad1296b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:20.092754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-25172bcb-5f4d-4717-8af9-b10a7ad1296b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:20.095964 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-25172bcb-5f4d-4717-8af9-b10a7ad1296b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:20.096484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-25172bcb-5f4d-4717-8af9-b10a7ad1296b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:20.097481 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-25172bcb-5f4d-4717-8af9-b10a7ad1296b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:20.097887 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-25172bcb-5f4d-4717-8af9-b10a7ad1296b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:20.235089 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-25172bcb-5f4d-4717-8af9-b10a7ad1296b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:20.243522 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-25172bcb-5f4d-4717-8af9-b10a7ad1296b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1279 microversion: 2.1 time: 0.159710 Jul 18 10:53:20.244101 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 363/748] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:20 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1279 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:20.780016 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3582bff4-0eb9-4148-a108-4e3b3e2368ac tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:20.780632 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3582bff4-0eb9-4148-a108-4e3b3e2368ac tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:20.788882 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3582bff4-0eb9-4148-a108-4e3b3e2368ac tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:20.789342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3582bff4-0eb9-4148-a108-4e3b3e2368ac tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:20.790140 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3582bff4-0eb9-4148-a108-4e3b3e2368ac tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:20.790626 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3582bff4-0eb9-4148-a108-4e3b3e2368ac tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:20.931574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3582bff4-0eb9-4148-a108-4e3b3e2368ac tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:20.939538 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3582bff4-0eb9-4148-a108-4e3b3e2368ac tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:20.941045 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3582bff4-0eb9-4148-a108-4e3b3e2368ac tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:20.942199 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3582bff4-0eb9-4148-a108-4e3b3e2368ac tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1722 microversion: 2.20 time: 0.166206 Jul 18 10:53:20.942776 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 386/749] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:20 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:21.260769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3f87b11f-75e2-445e-84a0-88fbaf1d3b68 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:21.261417 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3f87b11f-75e2-445e-84a0-88fbaf1d3b68 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:21.263970 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=2 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:21.269333 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3f87b11f-75e2-445e-84a0-88fbaf1d3b68 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:21.269769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3f87b11f-75e2-445e-84a0-88fbaf1d3b68 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:21.270538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3f87b11f-75e2-445e-84a0-88fbaf1d3b68 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:21.271164 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3f87b11f-75e2-445e-84a0-88fbaf1d3b68 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:21.415468 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3f87b11f-75e2-445e-84a0-88fbaf1d3b68 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:21.423921 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3f87b11f-75e2-445e-84a0-88fbaf1d3b68 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1279 microversion: 2.1 time: 0.167329 Jul 18 10:53:21.442019 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 364/750] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:21 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1279 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:21.962517 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f33d2465-7224-4397-acef-45e202951dbd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:21.963291 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f33d2465-7224-4397-acef-45e202951dbd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:21.971291 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f33d2465-7224-4397-acef-45e202951dbd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:21.971723 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f33d2465-7224-4397-acef-45e202951dbd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:21.972836 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f33d2465-7224-4397-acef-45e202951dbd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:21.973299 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f33d2465-7224-4397-acef-45e202951dbd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:22.020944 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-766784c0-675c-4363-9a38-f5485f0594f9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:22.022003 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-766784c0-675c-4363-9a38-f5485f0594f9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:22.028961 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-766784c0-675c-4363-9a38-f5485f0594f9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:22.029555 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-766784c0-675c-4363-9a38-f5485f0594f9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:22.030340 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-766784c0-675c-4363-9a38-f5485f0594f9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:22.030777 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-766784c0-675c-4363-9a38-f5485f0594f9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:22.063618 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-766784c0-675c-4363-9a38-f5485f0594f9 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046737 Jul 18 10:53:22.064195 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 365/751] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:53:22 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:53:22.128842 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f33d2465-7224-4397-acef-45e202951dbd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:22.141331 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f33d2465-7224-4397-acef-45e202951dbd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:22.143135 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f33d2465-7224-4397-acef-45e202951dbd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:22.144545 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f33d2465-7224-4397-acef-45e202951dbd tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1722 microversion: 2.20 time: 0.187390 Jul 18 10:53:22.145367 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 387/752] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:21 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:22.203027 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2bdf845a-cf77-4e09-b6fd-1905027201cd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:22.203658 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2bdf845a-cf77-4e09-b6fd-1905027201cd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:22.211015 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2bdf845a-cf77-4e09-b6fd-1905027201cd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:22.211601 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2bdf845a-cf77-4e09-b6fd-1905027201cd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:22.212792 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2bdf845a-cf77-4e09-b6fd-1905027201cd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:22.213126 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2bdf845a-cf77-4e09-b6fd-1905027201cd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:22.247620 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2bdf845a-cf77-4e09-b6fd-1905027201cd tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments/76746fa1-3296-4b90-8925-970b76790e41" status: 200 len: 194 microversion: 2.1 time: 0.048457 Jul 18 10:53:22.248241 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 366/753] 10.222.0.49 () {58 vars in 1412 bytes} [Mon Jul 18 10:53:22 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments/76746fa1-3296-4b90-8925-970b76790e41 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:22.258502 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-828a5e32-7f02-4805-9e4f-dcfbf007df3f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:22.258996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-828a5e32-7f02-4805-9e4f-dcfbf007df3f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:22.265851 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-828a5e32-7f02-4805-9e4f-dcfbf007df3f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:22.266294 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-828a5e32-7f02-4805-9e4f-dcfbf007df3f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:22.267090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-828a5e32-7f02-4805-9e4f-dcfbf007df3f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:22.267501 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-828a5e32-7f02-4805-9e4f-dcfbf007df3f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:22.375855 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-828a5e32-7f02-4805-9e4f-dcfbf007df3f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lazy-loading 'services' on Instance uuid bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:53:22.442467 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-224615af-0a41-4c0a-876d-29bab7a06c9d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:22.443079 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-224615af-0a41-4c0a-876d-29bab7a06c9d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:22.450301 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-224615af-0a41-4c0a-876d-29bab7a06c9d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:22.450749 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-224615af-0a41-4c0a-876d-29bab7a06c9d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:22.451523 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-224615af-0a41-4c0a-876d-29bab7a06c9d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:22.451959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-224615af-0a41-4c0a-876d-29bab7a06c9d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:22.597229 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-224615af-0a41-4c0a-876d-29bab7a06c9d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:22.605115 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-224615af-0a41-4c0a-876d-29bab7a06c9d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1279 microversion: 2.1 time: 0.166510 Jul 18 10:53:22.605686 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 367/754] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:22 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1279 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:22.738439 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-828a5e32-7f02-4805-9e4f-dcfbf007df3f tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments/76746fa1-3296-4b90-8925-970b76790e41" status: 202 len: 0 microversion: 2.1 time: 0.483867 Jul 18 10:53:22.739003 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 388/755] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 18 10:53:22 2022] DELETE /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments/76746fa1-3296-4b90-8925-970b76790e41 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:53:23.166323 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c8ec73b5-49d9-445f-b7c9-1e81a3248633 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:23.166935 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c8ec73b5-49d9-445f-b7c9-1e81a3248633 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:23.173510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c8ec73b5-49d9-445f-b7c9-1e81a3248633 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:23.174063 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c8ec73b5-49d9-445f-b7c9-1e81a3248633 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:23.175107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c8ec73b5-49d9-445f-b7c9-1e81a3248633 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:23.175653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c8ec73b5-49d9-445f-b7c9-1e81a3248633 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:23.277071 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=10 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:23.311461 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c8ec73b5-49d9-445f-b7c9-1e81a3248633 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:23.319833 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c8ec73b5-49d9-445f-b7c9-1e81a3248633 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:23.321580 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c8ec73b5-49d9-445f-b7c9-1e81a3248633 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:23.322727 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c8ec73b5-49d9-445f-b7c9-1e81a3248633 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1722 microversion: 2.20 time: 0.162225 Jul 18 10:53:23.323279 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 368/756] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:23 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:53:23.623185 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e4bbbc46-5c33-49dc-89dc-a478787b1ae4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:23.623793 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-e4bbbc46-5c33-49dc-89dc-a478787b1ae4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:23.630316 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e4bbbc46-5c33-49dc-89dc-a478787b1ae4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:23.630775 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e4bbbc46-5c33-49dc-89dc-a478787b1ae4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:23.631756 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e4bbbc46-5c33-49dc-89dc-a478787b1ae4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:23.632191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e4bbbc46-5c33-49dc-89dc-a478787b1ae4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:23.776414 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e4bbbc46-5c33-49dc-89dc-a478787b1ae4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:23.784254 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e4bbbc46-5c33-49dc-89dc-a478787b1ae4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1267 microversion: 2.1 time: 0.165886 Jul 18 10:53:23.784854 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 389/757] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:23 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:24.341441 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c5a674f8-0aba-4ac4-85df-cce669768b74 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:24.344131 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c5a674f8-0aba-4ac4-85df-cce669768b74 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:24.348665 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c5a674f8-0aba-4ac4-85df-cce669768b74 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:24.349191 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c5a674f8-0aba-4ac4-85df-cce669768b74 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:24.349990 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c5a674f8-0aba-4ac4-85df-cce669768b74 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:24.350740 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c5a674f8-0aba-4ac4-85df-cce669768b74 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:24.540375 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c5a674f8-0aba-4ac4-85df-cce669768b74 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:24.548731 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c5a674f8-0aba-4ac4-85df-cce669768b74 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:24.550361 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c5a674f8-0aba-4ac4-85df-cce669768b74 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:24.551534 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c5a674f8-0aba-4ac4-85df-cce669768b74 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1722 microversion: 2.20 time: 0.214650 Jul 18 10:53:24.552250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 369/758] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:24 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:24.807784 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-61b4c9df-f3c3-4cf1-8e56-6c609a619640 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:24.808576 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-61b4c9df-f3c3-4cf1-8e56-6c609a619640 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:24.817883 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-61b4c9df-f3c3-4cf1-8e56-6c609a619640 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:24.818610 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-61b4c9df-f3c3-4cf1-8e56-6c609a619640 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:24.819628 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-61b4c9df-f3c3-4cf1-8e56-6c609a619640 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:24.820143 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-61b4c9df-f3c3-4cf1-8e56-6c609a619640 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:24.919969 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-663c9653-be43-481b-af46-6ebee2209dc1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:24.920456 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-663c9653-be43-481b-af46-6ebee2209dc1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:24.926740 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-663c9653-be43-481b-af46-6ebee2209dc1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:24.927204 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-663c9653-be43-481b-af46-6ebee2209dc1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:24.928585 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-663c9653-be43-481b-af46-6ebee2209dc1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:24.929380 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-663c9653-be43-481b-af46-6ebee2209dc1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:24.961180 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-663c9653-be43-481b-af46-6ebee2209dc1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments/25a10f4b-b1cf-4ffe-9ab3-907d617cecc7" status: 200 len: 194 microversion: 2.1 time: 0.044922 Jul 18 10:53:24.961739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 370/759] 10.222.0.49 () {58 vars in 1412 bytes} [Mon Jul 18 10:53:24 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments/25a10f4b-b1cf-4ffe-9ab3-907d617cecc7 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:24.966167 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-61b4c9df-f3c3-4cf1-8e56-6c609a619640 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:24.971881 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b5967f39-37f7-4ec8-8317-e87ca84458f4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:24.972443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b5967f39-37f7-4ec8-8317-e87ca84458f4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:24.973893 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-61b4c9df-f3c3-4cf1-8e56-6c609a619640 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1267 microversion: 2.1 time: 0.171521 Jul 18 10:53:24.974476 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 390/760] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:24 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:24.981789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b5967f39-37f7-4ec8-8317-e87ca84458f4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:24.982237 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b5967f39-37f7-4ec8-8317-e87ca84458f4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:24.986041 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b5967f39-37f7-4ec8-8317-e87ca84458f4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:24.986041 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b5967f39-37f7-4ec8-8317-e87ca84458f4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:25.070668 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-b5967f39-37f7-4ec8-8317-e87ca84458f4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lazy-loading 'services' on Instance uuid bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:53:25.386097 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b5967f39-37f7-4ec8-8317-e87ca84458f4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments/25a10f4b-b1cf-4ffe-9ab3-907d617cecc7" status: 202 len: 0 microversion: 2.1 time: 0.417841 Jul 18 10:53:25.387002 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 371/761] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 18 10:53:24 2022] DELETE /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments/25a10f4b-b1cf-4ffe-9ab3-907d617cecc7 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 10:53:25.572460 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-64ba751b-b435-43ec-b540-8a7a6f9dfc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:25.573216 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-64ba751b-b435-43ec-b540-8a7a6f9dfc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:25.579589 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-64ba751b-b435-43ec-b540-8a7a6f9dfc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:25.582753 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-64ba751b-b435-43ec-b540-8a7a6f9dfc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:25.582753 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-64ba751b-b435-43ec-b540-8a7a6f9dfc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:25.582753 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-64ba751b-b435-43ec-b540-8a7a6f9dfc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:25.719817 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-64ba751b-b435-43ec-b540-8a7a6f9dfc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:25.728508 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-64ba751b-b435-43ec-b540-8a7a6f9dfc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:25.730028 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-64ba751b-b435-43ec-b540-8a7a6f9dfc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:25.731234 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-64ba751b-b435-43ec-b540-8a7a6f9dfc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1743 microversion: 2.20 time: 0.164039 Jul 18 10:53:25.731747 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 391/762] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:25 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:25.992628 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a7635099-ecad-4679-8fa2-c8c58d614c62 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:25.993349 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a7635099-ecad-4679-8fa2-c8c58d614c62 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:25.999959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a7635099-ecad-4679-8fa2-c8c58d614c62 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:26.000400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a7635099-ecad-4679-8fa2-c8c58d614c62 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:26.001263 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a7635099-ecad-4679-8fa2-c8c58d614c62 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:26.001693 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a7635099-ecad-4679-8fa2-c8c58d614c62 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:26.149000 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a7635099-ecad-4679-8fa2-c8c58d614c62 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:26.156760 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a7635099-ecad-4679-8fa2-c8c58d614c62 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1267 microversion: 2.1 time: 0.168890 Jul 18 10:53:26.157386 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 372/763] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:25 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:26.750556 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-c55221ac-b1c0-4505-af90-ecc59b70c91c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:26.751229 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-c55221ac-b1c0-4505-af90-ecc59b70c91c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:26.760814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c55221ac-b1c0-4505-af90-ecc59b70c91c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:26.763084 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c55221ac-b1c0-4505-af90-ecc59b70c91c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:26.763084 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c55221ac-b1c0-4505-af90-ecc59b70c91c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:26.763084 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c55221ac-b1c0-4505-af90-ecc59b70c91c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:26.933696 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c55221ac-b1c0-4505-af90-ecc59b70c91c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:26.941843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c55221ac-b1c0-4505-af90-ecc59b70c91c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:26.943381 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c55221ac-b1c0-4505-af90-ecc59b70c91c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:26.944674 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-c55221ac-b1c0-4505-af90-ecc59b70c91c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1743 microversion: 2.20 time: 0.198004 Jul 18 10:53:26.945268 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 392/764] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:26 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1743 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:27.177226 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-aea3955d-d540-43ff-9cb8-c14a2b661121 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:27.179277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-aea3955d-d540-43ff-9cb8-c14a2b661121 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:27.188872 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:27.192405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-aea3955d-d540-43ff-9cb8-c14a2b661121 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:27.193004 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-aea3955d-d540-43ff-9cb8-c14a2b661121 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:27.194332 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-aea3955d-d540-43ff-9cb8-c14a2b661121 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:27.194822 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-aea3955d-d540-43ff-9cb8-c14a2b661121 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:27.339081 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-aea3955d-d540-43ff-9cb8-c14a2b661121 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:27.346984 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-aea3955d-d540-43ff-9cb8-c14a2b661121 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1267 microversion: 2.1 time: 0.176312 Jul 18 10:53:27.347558 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 373/765] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:27 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:27.620272 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f2c4d6c5-75e0-44b4-bb27-c290d8989df1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:27.621301 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f2c4d6c5-75e0-44b4-bb27-c290d8989df1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:27.628848 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f2c4d6c5-75e0-44b4-bb27-c290d8989df1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:27.629301 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f2c4d6c5-75e0-44b4-bb27-c290d8989df1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:27.630081 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f2c4d6c5-75e0-44b4-bb27-c290d8989df1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:27.630525 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f2c4d6c5-75e0-44b4-bb27-c290d8989df1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:27.664015 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f2c4d6c5-75e0-44b4-bb27-c290d8989df1 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047666 Jul 18 10:53:27.664591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 393/766] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:53:27 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:53:27.779275 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-98702874-6da2-4beb-80e1-435efeea68f4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:27.780269 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-98702874-6da2-4beb-80e1-435efeea68f4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:27.786760 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-98702874-6da2-4beb-80e1-435efeea68f4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:27.787227 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-98702874-6da2-4beb-80e1-435efeea68f4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:27.788013 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-98702874-6da2-4beb-80e1-435efeea68f4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:27.788460 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-98702874-6da2-4beb-80e1-435efeea68f4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:27.822199 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-98702874-6da2-4beb-80e1-435efeea68f4 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047237 Jul 18 10:53:27.822848 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 374/767] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:53:27 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:53:27.890883 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a1998068-db99-4a09-9086-c38f238896e7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:27.891568 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a1998068-db99-4a09-9086-c38f238896e7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:27.902290 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a1998068-db99-4a09-9086-c38f238896e7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:27.902972 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a1998068-db99-4a09-9086-c38f238896e7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:27.903974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a1998068-db99-4a09-9086-c38f238896e7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:27.904585 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a1998068-db99-4a09-9086-c38f238896e7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:27.936251 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a1998068-db99-4a09-9086-c38f238896e7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Going to try to terminate instance {{(pid=125007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:53:27.964120 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-ff95a33f-bce6-4d0c-8d7d-bd2e13ce8257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:27.964730 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-ff95a33f-bce6-4d0c-8d7d-bd2e13ce8257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:27.971590 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ff95a33f-bce6-4d0c-8d7d-bd2e13ce8257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:27.972368 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ff95a33f-bce6-4d0c-8d7d-bd2e13ce8257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:27.973172 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ff95a33f-bce6-4d0c-8d7d-bd2e13ce8257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:27.973633 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ff95a33f-bce6-4d0c-8d7d-bd2e13ce8257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:28.109451 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ff95a33f-bce6-4d0c-8d7d-bd2e13ce8257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:28.117705 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ff95a33f-bce6-4d0c-8d7d-bd2e13ce8257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:28.119224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-ff95a33f-bce6-4d0c-8d7d-bd2e13ce8257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:28.120483 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-ff95a33f-bce6-4d0c-8d7d-bd2e13ce8257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1743 microversion: 2.20 time: 0.161397 Jul 18 10:53:28.121080 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 375/768] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:27 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:53:28.323361 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a1998068-db99-4a09-9086-c38f238896e7 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 204 len: 0 microversion: 2.1 time: 0.439091 Jul 18 10:53:28.323957 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 394/769] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:53:27 2022] DELETE /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:53:28.332761 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-20ff00c9-d508-413d-bdc7-0f7be9a19a57 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:28.333530 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-20ff00c9-d508-413d-bdc7-0f7be9a19a57 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:28.341201 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-20ff00c9-d508-413d-bdc7-0f7be9a19a57 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:28.341653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-20ff00c9-d508-413d-bdc7-0f7be9a19a57 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:28.342428 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-20ff00c9-d508-413d-bdc7-0f7be9a19a57 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:28.342955 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-20ff00c9-d508-413d-bdc7-0f7be9a19a57 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:28.358266 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:28.365818 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-75c402ef-b79f-4fab-952f-7e7a6f34f805 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:28.366668 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-75c402ef-b79f-4fab-952f-7e7a6f34f805 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:28.373458 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-75c402ef-b79f-4fab-952f-7e7a6f34f805 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:28.373904 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-75c402ef-b79f-4fab-952f-7e7a6f34f805 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:28.374662 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-75c402ef-b79f-4fab-952f-7e7a6f34f805 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:28.375093 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-75c402ef-b79f-4fab-952f-7e7a6f34f805 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:28.561965 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-20ff00c9-d508-413d-bdc7-0f7be9a19a57 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:28.572722 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-20ff00c9-d508-413d-bdc7-0f7be9a19a57 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1671 microversion: 2.1 time: 0.243889 Jul 18 10:53:28.573449 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 376/770] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:28 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1671 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:28.580238 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-75c402ef-b79f-4fab-952f-7e7a6f34f805 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:28.589382 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-75c402ef-b79f-4fab-952f-7e7a6f34f805 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1267 microversion: 2.1 time: 0.228025 Jul 18 10:53:28.589965 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 395/771] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:28 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:28.847077 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-b559879b-f919-4184-9cb5-6e5721a2e0f0 req-7e6bea2d-b333-48f4-beea-76f0510aa9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1b361f-a048-4231-8c87-b3b27c478f7d", "name": "network-vif-plugged", "status": "completed", "tag": "e168237a-b0b4-42cb-8c89-d5ade5d9cf57"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:28.856081 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-b559879b-f919-4184-9cb5-6e5721a2e0f0 req-7e6bea2d-b333-48f4-beea-76f0510aa9c5 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:28.856521 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-b559879b-f919-4184-9cb5-6e5721a2e0f0 req-7e6bea2d-b333-48f4-beea-76f0510aa9c5 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:28.868946 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-b559879b-f919-4184-9cb5-6e5721a2e0f0 req-7e6bea2d-b333-48f4-beea-76f0510aa9c5 service nova] Creating event network-vif-plugged:e168237a-b0b4-42cb-8c89-d5ade5d9cf57 for instance 4f1b361f-a048-4231-8c87-b3b27c478f7d on hv-cinder-84949 Jul 18 10:53:28.873890 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-b559879b-f919-4184-9cb5-6e5721a2e0f0 req-7e6bea2d-b333-48f4-beea-76f0510aa9c5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030885 Jul 18 10:53:28.878566 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 377/772] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:29.138659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-7c33c67c-d6bc-4364-a6a3-adfb2c6da313 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:29.139259 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-7c33c67c-d6bc-4364-a6a3-adfb2c6da313 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:29.145720 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7c33c67c-d6bc-4364-a6a3-adfb2c6da313 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:29.146171 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7c33c67c-d6bc-4364-a6a3-adfb2c6da313 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:29.147739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7c33c67c-d6bc-4364-a6a3-adfb2c6da313 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:29.148204 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7c33c67c-d6bc-4364-a6a3-adfb2c6da313 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:29.292410 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7c33c67c-d6bc-4364-a6a3-adfb2c6da313 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:29.300177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7c33c67c-d6bc-4364-a6a3-adfb2c6da313 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:29.301697 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7c33c67c-d6bc-4364-a6a3-adfb2c6da313 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:29.302911 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-7c33c67c-d6bc-4364-a6a3-adfb2c6da313 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1738 microversion: 2.20 time: 0.168286 Jul 18 10:53:29.303576 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 396/773] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:29 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:29.392546 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b8cf4696-63ff-43a1-8772-7f59664a3de3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:29.393126 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b8cf4696-63ff-43a1-8772-7f59664a3de3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:29.400244 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b8cf4696-63ff-43a1-8772-7f59664a3de3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:29.400697 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b8cf4696-63ff-43a1-8772-7f59664a3de3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:29.418644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b8cf4696-63ff-43a1-8772-7f59664a3de3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:29.418644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b8cf4696-63ff-43a1-8772-7f59664a3de3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:29.425504 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-b8cf4696-63ff-43a1-8772-7f59664a3de3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lazy-loading 'flavor' on Instance uuid 3dab0fce-91d6-4e37-970c-02ba8250d354 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:53:29.596412 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d6da66de-0f77-43c5-9856-29e4e35f1266 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:29.596412 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d6da66de-0f77-43c5-9856-29e4e35f1266 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:29.599282 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6da66de-0f77-43c5-9856-29e4e35f1266 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:29.600019 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6da66de-0f77-43c5-9856-29e4e35f1266 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:29.600936 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6da66de-0f77-43c5-9856-29e4e35f1266 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:29.601451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6da66de-0f77-43c5-9856-29e4e35f1266 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:29.738692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d6da66de-0f77-43c5-9856-29e4e35f1266 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:29.747165 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d6da66de-0f77-43c5-9856-29e4e35f1266 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1671 microversion: 2.1 time: 0.160169 Jul 18 10:53:29.747729 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 397/774] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:29 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:29.752337 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ddc36ff9-b366-47b6-ad30-82b0e73c0fcd tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:29.752984 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ddc36ff9-b366-47b6-ad30-82b0e73c0fcd tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:29.768761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ddc36ff9-b366-47b6-ad30-82b0e73c0fcd tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:29.768761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ddc36ff9-b366-47b6-ad30-82b0e73c0fcd tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:29.769098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ddc36ff9-b366-47b6-ad30-82b0e73c0fcd tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:29.769531 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ddc36ff9-b366-47b6-ad30-82b0e73c0fcd tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:29.919514 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ddc36ff9-b366-47b6-ad30-82b0e73c0fcd tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:29.922589 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b8cf4696-63ff-43a1-8772-7f59664a3de3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "POST /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354/action" status: 202 len: 0 microversion: 2.1 time: 0.534631 Jul 18 10:53:29.923244 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 378/775] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 18 10:53:29 2022] POST /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:53:29.928236 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ddc36ff9-b366-47b6-ad30-82b0e73c0fcd tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1267 microversion: 2.1 time: 0.178656 Jul 18 10:53:29.928845 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 398/776] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:29 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:29.933677 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5bbd1b80-a763-456f-b8df-79251e090dca tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:29.934370 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5bbd1b80-a763-456f-b8df-79251e090dca tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:29.941979 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5bbd1b80-a763-456f-b8df-79251e090dca tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:29.941979 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5bbd1b80-a763-456f-b8df-79251e090dca tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:29.942300 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5bbd1b80-a763-456f-b8df-79251e090dca tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:29.942741 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5bbd1b80-a763-456f-b8df-79251e090dca tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:30.085778 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5bbd1b80-a763-456f-b8df-79251e090dca tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:30.093987 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5bbd1b80-a763-456f-b8df-79251e090dca tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.164583 Jul 18 10:53:30.094561 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 379/777] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:29 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:30.322523 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-52f85270-d78b-4748-8b87-2a4b0d494d2d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:30.323094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-52f85270-d78b-4748-8b87-2a4b0d494d2d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:30.329833 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-52f85270-d78b-4748-8b87-2a4b0d494d2d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:30.330315 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-52f85270-d78b-4748-8b87-2a4b0d494d2d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:30.331089 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-52f85270-d78b-4748-8b87-2a4b0d494d2d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:30.331536 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-52f85270-d78b-4748-8b87-2a4b0d494d2d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:30.470333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-52f85270-d78b-4748-8b87-2a4b0d494d2d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:30.472652 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:30.479517 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-52f85270-d78b-4748-8b87-2a4b0d494d2d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:30.481089 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-52f85270-d78b-4748-8b87-2a4b0d494d2d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:30.482290 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-52f85270-d78b-4748-8b87-2a4b0d494d2d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1738 microversion: 2.20 time: 0.164508 Jul 18 10:53:30.484811 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 399/778] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:30 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:30.766495 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-94621e4d-4178-4fa5-858b-3de7b92e7bb0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:30.767129 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-94621e4d-4178-4fa5-858b-3de7b92e7bb0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:30.774862 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-94621e4d-4178-4fa5-858b-3de7b92e7bb0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:30.775310 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-94621e4d-4178-4fa5-858b-3de7b92e7bb0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:30.776082 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-94621e4d-4178-4fa5-858b-3de7b92e7bb0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:30.776508 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-94621e4d-4178-4fa5-858b-3de7b92e7bb0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:30.947267 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2dd399bb-e484-459a-bf5f-51384db042d6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:30.948045 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2dd399bb-e484-459a-bf5f-51384db042d6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:30.972234 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2dd399bb-e484-459a-bf5f-51384db042d6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:30.972741 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2dd399bb-e484-459a-bf5f-51384db042d6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:30.973689 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2dd399bb-e484-459a-bf5f-51384db042d6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:30.974323 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2dd399bb-e484-459a-bf5f-51384db042d6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:31.318301 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-94621e4d-4178-4fa5-858b-3de7b92e7bb0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:31.332196 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-94621e4d-4178-4fa5-858b-3de7b92e7bb0 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1671 microversion: 2.1 time: 0.567615 Jul 18 10:53:31.332196 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 380/779] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:30 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1671 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:31.337580 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2294481b-f27f-43e0-b4ef-4033f4887035 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:31.338533 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2294481b-f27f-43e0-b4ef-4033f4887035 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:31.346109 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2294481b-f27f-43e0-b4ef-4033f4887035 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:31.346906 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2294481b-f27f-43e0-b4ef-4033f4887035 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:31.347920 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2294481b-f27f-43e0-b4ef-4033f4887035 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:31.348599 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2294481b-f27f-43e0-b4ef-4033f4887035 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:31.416407 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2dd399bb-e484-459a-bf5f-51384db042d6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:31.425402 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2dd399bb-e484-459a-bf5f-51384db042d6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1267 microversion: 2.1 time: 0.483461 Jul 18 10:53:31.425993 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 400/780] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:30 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1267 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:31.504971 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9773f490-c79d-4ca0-b473-b3cd35db0c5e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:31.506949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9773f490-c79d-4ca0-b473-b3cd35db0c5e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:31.513847 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9773f490-c79d-4ca0-b473-b3cd35db0c5e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:31.514658 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9773f490-c79d-4ca0-b473-b3cd35db0c5e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:31.515698 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9773f490-c79d-4ca0-b473-b3cd35db0c5e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:31.516340 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9773f490-c79d-4ca0-b473-b3cd35db0c5e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:31.531187 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-2294481b-f27f-43e0-b4ef-4033f4887035 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:31.540636 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2294481b-f27f-43e0-b4ef-4033f4887035 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.208391 Jul 18 10:53:31.552886 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 381/781] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:31 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:31.660607 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9773f490-c79d-4ca0-b473-b3cd35db0c5e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:31.669543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9773f490-c79d-4ca0-b473-b3cd35db0c5e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:31.677441 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9773f490-c79d-4ca0-b473-b3cd35db0c5e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:31.677441 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9773f490-c79d-4ca0-b473-b3cd35db0c5e tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1738 microversion: 2.20 time: 0.174603 Jul 18 10:53:31.677441 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 401/782] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:31 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:53:32.351690 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-5a24feb4-9b14-4119-9514-610bb2d03b1a req-f1187589-41e5-40e8-ae06-65ec0e298711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9", "name": "network-vif-deleted", "tag": "47325516-1ea0-48d9-af9c-813d48dafa61"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:32.352083 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-69f2a481-fa53-4842-92ca-539070530fbc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:32.352724 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-69f2a481-fa53-4842-92ca-539070530fbc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:32.361316 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-69f2a481-fa53-4842-92ca-539070530fbc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:32.362031 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-69f2a481-fa53-4842-92ca-539070530fbc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:32.363005 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-69f2a481-fa53-4842-92ca-539070530fbc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:32.363606 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-69f2a481-fa53-4842-92ca-539070530fbc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:32.373797 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-5a24feb4-9b14-4119-9514-610bb2d03b1a req-f1187589-41e5-40e8-ae06-65ec0e298711 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:32.374469 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-5a24feb4-9b14-4119-9514-610bb2d03b1a req-f1187589-41e5-40e8-ae06-65ec0e298711 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:32.391419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-5a24feb4-9b14-4119-9514-610bb2d03b1a req-f1187589-41e5-40e8-ae06-65ec0e298711 service nova] Creating event network-vif-deleted:47325516-1ea0-48d9-af9c-813d48dafa61 for instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 on hv-cinder-84949 Jul 18 10:53:32.407862 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-5a24feb4-9b14-4119-9514-610bb2d03b1a req-f1187589-41e5-40e8-ae06-65ec0e298711 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061506 Jul 18 10:53:32.416149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 402/783] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:53:32.449926 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f2ee49a6-f017-4feb-bcd9-ec646e97648d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:32.452133 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f2ee49a6-f017-4feb-bcd9-ec646e97648d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:32.458450 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f2ee49a6-f017-4feb-bcd9-ec646e97648d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:32.459545 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f2ee49a6-f017-4feb-bcd9-ec646e97648d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:32.460543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f2ee49a6-f017-4feb-bcd9-ec646e97648d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:32.461175 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f2ee49a6-f017-4feb-bcd9-ec646e97648d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:32.488461 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-69f2a481-fa53-4842-92ca-539070530fbc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:32.506589 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-69f2a481-fa53-4842-92ca-539070530fbc tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1604 microversion: 2.1 time: 0.160392 Jul 18 10:53:32.507984 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 382/784] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:32 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1604 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:32.561644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9750b44b-3a92-4714-9f34-d337f44f1dbd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:32.562367 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-9750b44b-3a92-4714-9f34-d337f44f1dbd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:32.626018 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9750b44b-3a92-4714-9f34-d337f44f1dbd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:32.627225 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9750b44b-3a92-4714-9f34-d337f44f1dbd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:32.629493 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9750b44b-3a92-4714-9f34-d337f44f1dbd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:32.630058 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9750b44b-3a92-4714-9f34-d337f44f1dbd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:32.696856 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f2ee49a6-f017-4feb-bcd9-ec646e97648d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:32.708169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f2ee49a6-f017-4feb-bcd9-ec646e97648d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1267 microversion: 2.1 time: 0.269286 Jul 18 10:53:32.709454 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 403/785] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:32 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1267 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:32.731203 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f98e8931-9d20-423c-812a-3205b00eeaed tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:32.732663 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f98e8931-9d20-423c-812a-3205b00eeaed tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:32.740629 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f98e8931-9d20-423c-812a-3205b00eeaed tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:32.741693 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f98e8931-9d20-423c-812a-3205b00eeaed tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:32.742665 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f98e8931-9d20-423c-812a-3205b00eeaed tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:32.743352 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f98e8931-9d20-423c-812a-3205b00eeaed tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:32.894121 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9750b44b-3a92-4714-9f34-d337f44f1dbd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:32.903644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9750b44b-3a92-4714-9f34-d337f44f1dbd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.347261 Jul 18 10:53:32.912521 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 383/786] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:32 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:32.988945 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f98e8931-9d20-423c-812a-3205b00eeaed tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:32.998924 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f98e8931-9d20-423c-812a-3205b00eeaed tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:33.000082 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f98e8931-9d20-423c-812a-3205b00eeaed tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:33.001473 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f98e8931-9d20-423c-812a-3205b00eeaed tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1738 microversion: 2.20 time: 0.274648 Jul 18 10:53:33.002959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 404/787] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:32 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:33.440959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-30665062-aa2a-449c-8dc7-98e88a109d42 req-a8426ed3-6d44-44ca-b9f5-348917ebe295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e75fba7-e72d-4479-ab36-0bbf9f294d22", "name": "network-vif-plugged", "status": "completed", "tag": "42168f45-7a03-471a-b163-85fef4b32faa"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:33.450582 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-30665062-aa2a-449c-8dc7-98e88a109d42 req-a8426ed3-6d44-44ca-b9f5-348917ebe295 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:33.451024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-30665062-aa2a-449c-8dc7-98e88a109d42 req-a8426ed3-6d44-44ca-b9f5-348917ebe295 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:33.464050 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-30665062-aa2a-449c-8dc7-98e88a109d42 req-a8426ed3-6d44-44ca-b9f5-348917ebe295 service nova] Creating event network-vif-plugged:42168f45-7a03-471a-b163-85fef4b32faa for instance 6e75fba7-e72d-4479-ab36-0bbf9f294d22 on hv-cinder-84949 Jul 18 10:53:33.476460 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-30665062-aa2a-449c-8dc7-98e88a109d42 req-a8426ed3-6d44-44ca-b9f5-348917ebe295 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032928 Jul 18 10:53:33.476460 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 384/788] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:33.527225 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-18d35d96-c6da-492d-8037-3fc77f57c000 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:33.527839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-18d35d96-c6da-492d-8037-3fc77f57c000 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:33.543776 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-18d35d96-c6da-492d-8037-3fc77f57c000 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:33.544494 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-18d35d96-c6da-492d-8037-3fc77f57c000 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:33.545459 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-18d35d96-c6da-492d-8037-3fc77f57c000 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:33.546124 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-18d35d96-c6da-492d-8037-3fc77f57c000 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:33.610389 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-18d35d96-c6da-492d-8037-3fc77f57c000 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:33.611593 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-18d35d96-c6da-492d-8037-3fc77f57c000 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:33.612073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-18d35d96-c6da-492d-8037-3fc77f57c000 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lazy-loading 'fault' on Instance uuid bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:53:33.666591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-18d35d96-c6da-492d-8037-3fc77f57c000 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbb489073d94425ad1a1b350768c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f32dc706424247d0ac1dc7a6aa633107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:33.676157 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-18d35d96-c6da-492d-8037-3fc77f57c000 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 200 len: 1326 microversion: 2.1 time: 0.153102 Jul 18 10:53:33.676744 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 405/789] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:33 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:33.728742 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2d9197a5-2c00-4dcc-b472-98745409bc43 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:33.729543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2d9197a5-2c00-4dcc-b472-98745409bc43 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:33.737581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2d9197a5-2c00-4dcc-b472-98745409bc43 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:33.738094 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2d9197a5-2c00-4dcc-b472-98745409bc43 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:33.739376 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2d9197a5-2c00-4dcc-b472-98745409bc43 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:33.739881 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2d9197a5-2c00-4dcc-b472-98745409bc43 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:33.931766 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-87587aa3-c5bf-4fa6-a2aa-55a6f9f8efe3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:33.932495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-87587aa3-c5bf-4fa6-a2aa-55a6f9f8efe3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:33.941282 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87587aa3-c5bf-4fa6-a2aa-55a6f9f8efe3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:33.942192 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87587aa3-c5bf-4fa6-a2aa-55a6f9f8efe3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:33.943950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87587aa3-c5bf-4fa6-a2aa-55a6f9f8efe3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:33.949219 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-87587aa3-c5bf-4fa6-a2aa-55a6f9f8efe3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:33.965494 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-2d9197a5-2c00-4dcc-b472-98745409bc43 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:33.974086 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2d9197a5-2c00-4dcc-b472-98745409bc43 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1267 microversion: 2.1 time: 0.250835 Jul 18 10:53:33.987069 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 385/790] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:33 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1267 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:34.024431 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3a4d8e94-cd16-4854-8ba2-80f09c3719f6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:34.026032 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3a4d8e94-cd16-4854-8ba2-80f09c3719f6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:34.035880 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3a4d8e94-cd16-4854-8ba2-80f09c3719f6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:34.036754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3a4d8e94-cd16-4854-8ba2-80f09c3719f6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:34.037808 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3a4d8e94-cd16-4854-8ba2-80f09c3719f6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:34.039009 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3a4d8e94-cd16-4854-8ba2-80f09c3719f6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:34.161870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-87587aa3-c5bf-4fa6-a2aa-55a6f9f8efe3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:34.181611 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-87587aa3-c5bf-4fa6-a2aa-55a6f9f8efe3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.255851 Jul 18 10:53:34.189783 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 406/791] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:33 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:34.258646 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3a4d8e94-cd16-4854-8ba2-80f09c3719f6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:34.268745 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3a4d8e94-cd16-4854-8ba2-80f09c3719f6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:34.270554 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3a4d8e94-cd16-4854-8ba2-80f09c3719f6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:34.272791 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3a4d8e94-cd16-4854-8ba2-80f09c3719f6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1738 microversion: 2.20 time: 0.253030 Jul 18 10:53:34.284938 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 386/792] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:34 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:34.696603 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-88d1b8ed-5309-4d37-9859-b3b5814be932 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:34.698490 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-88d1b8ed-5309-4d37-9859-b3b5814be932 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:34.705426 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:34.709462 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-88d1b8ed-5309-4d37-9859-b3b5814be932 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:34.710386 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-88d1b8ed-5309-4d37-9859-b3b5814be932 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:34.711379 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-88d1b8ed-5309-4d37-9859-b3b5814be932 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:34.711806 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-88d1b8ed-5309-4d37-9859-b3b5814be932 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:34.728077 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-88d1b8ed-5309-4d37-9859-b3b5814be932 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] HTTP exception thrown: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-88d1b8ed-5309-4d37-9859-b3b5814be932 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Request method failure captured: Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 HTTP/1.1 Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To1mq42Ndp7G5x96udz53cuzwL6rrizGEn7J54kIiI6bCBpM4QEifJN_jwy6kTx_0fXUcSEJkSlsI-UlpNR0WtCjid5hxedN7cOliEvOxhjD294gI8VWpwLOKlkBv6m-Z7iZlLisxYQ1hzNN67IJH-BGYcXhQ90dkJTv-nSnjs9eSM Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: f32dc706424247d0ac1dc7a6aa633107 Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:53:34.729777 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:53:34.731145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:53:34.731145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:53:34.731145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: f32dc706424247d0ac1dc7a6aa633107 Jul 18 10:53:34.731145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:53:34.731145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeTestJSON-528647951-project Jul 18 10:53:34.731145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:53:34.731145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:53:34.731145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 3dbb489073d94425ad1a1b350768c428 Jul 18 10:53:34.731145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeTestJSON-528647951-project Jul 18 10:53:34.731145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:53:34.731145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. Jul 18 10:53:34.731145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': 'bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9'} Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:34.731968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. Jul 18 10:53:34.733264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:34.735158 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-88d1b8ed-5309-4d37-9859-b3b5814be932 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Returning 404 to user: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:34.736178 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-88d1b8ed-5309-4d37-9859-b3b5814be932 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 404 len: 111 microversion: 2.1 time: 0.044534 Jul 18 10:53:34.737359 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 407/793] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:34 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:53:34.748287 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-466d20cd-a807-4f8c-b3ac-2719a9eb9b46 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '.version_select at 0x7f6364cb51f0>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:34.896712 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-466d20cd-a807-4f8c-b3ac-2719a9eb9b46 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-626116397" status: 202 len: 0 microversion: 2.1 time: 0.151870 Jul 18 10:53:34.897530 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 387/794] 10.222.0.49 () {58 vars in 1217 bytes} [Mon Jul 18 10:53:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-626116397 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 10:53:34.998511 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-359cc6cd-dce4-47d6-bc50-443bbb7098d0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:34.999559 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-359cc6cd-dce4-47d6-bc50-443bbb7098d0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:35.007487 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-359cc6cd-dce4-47d6-bc50-443bbb7098d0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:35.008469 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-359cc6cd-dce4-47d6-bc50-443bbb7098d0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:35.009535 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-359cc6cd-dce4-47d6-bc50-443bbb7098d0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:35.010199 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-359cc6cd-dce4-47d6-bc50-443bbb7098d0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:35.213582 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-359cc6cd-dce4-47d6-bc50-443bbb7098d0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:35.216392 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f9124ca6-78cc-4d36-ba28-aa059493073e tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:35.217115 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f9124ca6-78cc-4d36-ba28-aa059493073e tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:35.223919 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-359cc6cd-dce4-47d6-bc50-443bbb7098d0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1267 microversion: 2.1 time: 0.233776 Jul 18 10:53:35.225592 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f9124ca6-78cc-4d36-ba28-aa059493073e tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:35.225733 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 408/795] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:34 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:35.227107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f9124ca6-78cc-4d36-ba28-aa059493073e tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:35.232934 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f9124ca6-78cc-4d36-ba28-aa059493073e tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:35.232934 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f9124ca6-78cc-4d36-ba28-aa059493073e tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:35.342540 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-48907976-ec1b-4166-8ff0-cdc0f0807057 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:35.344221 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-48907976-ec1b-4166-8ff0-cdc0f0807057 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:35.353254 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-48907976-ec1b-4166-8ff0-cdc0f0807057 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:35.354990 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-48907976-ec1b-4166-8ff0-cdc0f0807057 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:35.355766 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-48907976-ec1b-4166-8ff0-cdc0f0807057 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:35.356207 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-48907976-ec1b-4166-8ff0-cdc0f0807057 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:35.466172 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f9124ca6-78cc-4d36-ba28-aa059493073e tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:35.479963 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f9124ca6-78cc-4d36-ba28-aa059493073e tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.267863 Jul 18 10:53:35.482959 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 388/796] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:35 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:35.548330 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-48907976-ec1b-4166-8ff0-cdc0f0807057 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:35.557073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-48907976-ec1b-4166-8ff0-cdc0f0807057 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:35.558830 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-48907976-ec1b-4166-8ff0-cdc0f0807057 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:35.560012 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-48907976-ec1b-4166-8ff0-cdc0f0807057 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1738 microversion: 2.20 time: 0.232595 Jul 18 10:53:35.560586 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 409/797] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:35 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:36.247568 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-86229568-6f95-468c-babc-71dea4398c7e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:36.248220 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-86229568-6f95-468c-babc-71dea4398c7e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:36.255331 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-86229568-6f95-468c-babc-71dea4398c7e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:36.256616 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-86229568-6f95-468c-babc-71dea4398c7e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:36.257787 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-86229568-6f95-468c-babc-71dea4398c7e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:36.258457 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-86229568-6f95-468c-babc-71dea4398c7e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:36.471542 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-86229568-6f95-468c-babc-71dea4398c7e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:36.480404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-86229568-6f95-468c-babc-71dea4398c7e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1453 microversion: 2.1 time: 0.236599 Jul 18 10:53:36.481800 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 389/798] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:36 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1453 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:36.500015 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5ec02490-55b1-40db-87de-0170a143e652 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:36.500459 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-5ec02490-55b1-40db-87de-0170a143e652 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:36.512008 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5ec02490-55b1-40db-87de-0170a143e652 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:36.512222 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-0e628f6a-c967-470d-b642-0a3547f1fb1a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:36.512711 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-0e628f6a-c967-470d-b642-0a3547f1fb1a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:36.513288 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5ec02490-55b1-40db-87de-0170a143e652 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:36.514179 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5ec02490-55b1-40db-87de-0170a143e652 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:36.515307 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5ec02490-55b1-40db-87de-0170a143e652 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:36.519799 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0e628f6a-c967-470d-b642-0a3547f1fb1a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:36.520530 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0e628f6a-c967-470d-b642-0a3547f1fb1a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:36.521470 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0e628f6a-c967-470d-b642-0a3547f1fb1a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:36.522395 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0e628f6a-c967-470d-b642-0a3547f1fb1a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:36.797395 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-5ec02490-55b1-40db-87de-0170a143e652 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:36.806042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5ec02490-55b1-40db-87de-0170a143e652 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.310410 Jul 18 10:53:36.815946 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 410/799] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:36 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:36.825817 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-19f514da-6ecf-49ea-b9ff-9251783150d0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:36.825817 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-19f514da-6ecf-49ea-b9ff-9251783150d0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:36.834947 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0e628f6a-c967-470d-b642-0a3547f1fb1a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:36.835702 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-19f514da-6ecf-49ea-b9ff-9251783150d0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:36.836163 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-19f514da-6ecf-49ea-b9ff-9251783150d0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:36.837031 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-19f514da-6ecf-49ea-b9ff-9251783150d0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:36.837660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-19f514da-6ecf-49ea-b9ff-9251783150d0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:36.851368 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-0e628f6a-c967-470d-b642-0a3547f1fb1a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1453 microversion: 2.1 time: 0.347973 Jul 18 10:53:36.853912 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 390/800] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:36 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1453 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:37.085793 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-19f514da-6ecf-49ea-b9ff-9251783150d0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:37.118174 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-19f514da-6ecf-49ea-b9ff-9251783150d0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:37.120538 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-19f514da-6ecf-49ea-b9ff-9251783150d0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:37.125117 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-19f514da-6ecf-49ea-b9ff-9251783150d0 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1738 microversion: 2.20 time: 0.310798 Jul 18 10:53:37.140870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 411/801] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:36 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1738 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:37.827006 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8681aeb1-ab13-4a00-8853-e5eb81eeb2f7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:37.831189 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8681aeb1-ab13-4a00-8853-e5eb81eeb2f7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:37.837078 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8681aeb1-ab13-4a00-8853-e5eb81eeb2f7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:37.838320 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8681aeb1-ab13-4a00-8853-e5eb81eeb2f7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:37.839293 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8681aeb1-ab13-4a00-8853-e5eb81eeb2f7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:37.840506 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8681aeb1-ab13-4a00-8853-e5eb81eeb2f7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:38.022224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8681aeb1-ab13-4a00-8853-e5eb81eeb2f7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:38.033632 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8681aeb1-ab13-4a00-8853-e5eb81eeb2f7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.213145 Jul 18 10:53:38.034923 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 391/802] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:37 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:38.146521 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-47c72343-1516-47b3-a7cc-2403fb205048 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:38.148044 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-47c72343-1516-47b3-a7cc-2403fb205048 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:38.155612 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-47c72343-1516-47b3-a7cc-2403fb205048 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:38.156381 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-47c72343-1516-47b3-a7cc-2403fb205048 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:38.157761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-47c72343-1516-47b3-a7cc-2403fb205048 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:38.158461 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-47c72343-1516-47b3-a7cc-2403fb205048 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:38.346598 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-47c72343-1516-47b3-a7cc-2403fb205048 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:38.356142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-47c72343-1516-47b3-a7cc-2403fb205048 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:38.358988 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-47c72343-1516-47b3-a7cc-2403fb205048 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:38.360433 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-47c72343-1516-47b3-a7cc-2403fb205048 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1738 microversion: 2.20 time: 0.219582 Jul 18 10:53:38.361494 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 412/803] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:38 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:39.051348 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7c85a8ab-6f1d-4099-921c-574b859717a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:39.052012 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-7c85a8ab-6f1d-4099-921c-574b859717a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:39.059628 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7c85a8ab-6f1d-4099-921c-574b859717a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:39.060069 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7c85a8ab-6f1d-4099-921c-574b859717a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:39.060925 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7c85a8ab-6f1d-4099-921c-574b859717a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:39.061310 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7c85a8ab-6f1d-4099-921c-574b859717a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:39.088564 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5370ffd2-a718-4674-bb51-3fa05a906f62 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:39.088892 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-5370ffd2-a718-4674-bb51-3fa05a906f62 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:39.098062 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5370ffd2-a718-4674-bb51-3fa05a906f62 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:39.098809 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5370ffd2-a718-4674-bb51-3fa05a906f62 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:39.100267 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5370ffd2-a718-4674-bb51-3fa05a906f62 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:39.101022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5370ffd2-a718-4674-bb51-3fa05a906f62 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:39.119302 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-5370ffd2-a718-4674-bb51-3fa05a906f62 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] HTTP exception thrown: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5370ffd2-a718-4674-bb51-3fa05a906f62 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Request method failure captured: Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: DELETE /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 HTTP/1.1 Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To1mq42Ndp7G5x96udz53cuzwL6rrizGEn7J54kIiI6bCBpM4QEifJN_jwy6kTx_0fXUcSEJkSlsI-UlpNR0WtCjid5hxedN7cOliEvOxhjD294gI8VWpwLOKlkBv6m-Z7iZlLisxYQ1hzNN67IJH-BGYcXhQ90dkJTv-nSnjs9eSM Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: f32dc706424247d0ac1dc7a6aa633107 Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:53:39.120951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:53:39.122212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:53:39.122212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:53:39.122212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: f32dc706424247d0ac1dc7a6aa633107 Jul 18 10:53:39.122212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:53:39.122212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeTestJSON-528647951-project Jul 18 10:53:39.122212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:53:39.122212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:53:39.122212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 3dbb489073d94425ad1a1b350768c428 Jul 18 10:53:39.122212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeTestJSON-528647951-project Jul 18 10:53:39.122212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:53:39.122212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. Jul 18 10:53:39.122212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': 'bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9'} Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:39.122908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. Jul 18 10:53:39.124050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:39.125252 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5370ffd2-a718-4674-bb51-3fa05a906f62 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Returning 404 to user: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:39.125252 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5370ffd2-a718-4674-bb51-3fa05a906f62 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 404 len: 111 microversion: 2.1 time: 0.039661 Jul 18 10:53:39.125252 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 413/804] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:53:39 2022] DELETE /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:53:39.131679 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f68a5b09-d3e1-429e-98bc-4676e18397c3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:39.132631 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f68a5b09-d3e1-429e-98bc-4676e18397c3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:39.139428 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f68a5b09-d3e1-429e-98bc-4676e18397c3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:39.139961 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f68a5b09-d3e1-429e-98bc-4676e18397c3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:39.140855 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f68a5b09-d3e1-429e-98bc-4676e18397c3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:39.141440 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f68a5b09-d3e1-429e-98bc-4676e18397c3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:39.157153 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-f68a5b09-d3e1-429e-98bc-4676e18397c3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] HTTP exception thrown: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f68a5b09-d3e1-429e-98bc-4676e18397c3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Request method failure captured: Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 HTTP/1.1 Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To1mq42Ndp7G5x96udz53cuzwL6rrizGEn7J54kIiI6bCBpM4QEifJN_jwy6kTx_0fXUcSEJkSlsI-UlpNR0WtCjid5hxedN7cOliEvOxhjD294gI8VWpwLOKlkBv6m-Z7iZlLisxYQ1hzNN67IJH-BGYcXhQ90dkJTv-nSnjs9eSM Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: f32dc706424247d0ac1dc7a6aa633107 Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:53:39.159641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:53:39.160949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:53:39.160949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:53:39.160949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: f32dc706424247d0ac1dc7a6aa633107 Jul 18 10:53:39.160949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:53:39.160949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeTestJSON-528647951-project Jul 18 10:53:39.160949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:53:39.160949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:53:39.160949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 3dbb489073d94425ad1a1b350768c428 Jul 18 10:53:39.160949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeTestJSON-528647951-project Jul 18 10:53:39.160949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:53:39.160949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. Jul 18 10:53:39.160949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': 'bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9'} Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:39.162240 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. Jul 18 10:53:39.163522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:39.166109 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f68a5b09-d3e1-429e-98bc-4676e18397c3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Returning 404 to user: Instance bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:39.166109 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f68a5b09-d3e1-429e-98bc-4676e18397c3 tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9" status: 404 len: 111 microversion: 2.1 time: 0.033692 Jul 18 10:53:39.166109 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 414/805] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:39 2022] GET /compute/v2.1/servers/bfcc60c6-ad37-42f4-bf9c-d59cdbe630c9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:53:39.234690 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7c85a8ab-6f1d-4099-921c-574b859717a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:39.244367 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7c85a8ab-6f1d-4099-921c-574b859717a3 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.196747 Jul 18 10:53:39.244985 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 392/806] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:39 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:39.378695 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-505f907c-df86-4c12-a905-0508ede42aa7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:39.379300 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-505f907c-df86-4c12-a905-0508ede42aa7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:39.394833 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-505f907c-df86-4c12-a905-0508ede42aa7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:39.394833 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-505f907c-df86-4c12-a905-0508ede42aa7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:39.394833 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-505f907c-df86-4c12-a905-0508ede42aa7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:39.394833 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-505f907c-df86-4c12-a905-0508ede42aa7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:39.567709 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-505f907c-df86-4c12-a905-0508ede42aa7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:39.586836 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-505f907c-df86-4c12-a905-0508ede42aa7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:39.588383 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-505f907c-df86-4c12-a905-0508ede42aa7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:39.589718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-505f907c-df86-4c12-a905-0508ede42aa7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1738 microversion: 2.20 time: 0.214959 Jul 18 10:53:39.602186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 415/807] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:39 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:39.756218 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-8c770bb6-ee47-42d9-981f-c194de798c57 req-614c78e6-f3c1-48d1-b441-441063f979b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e75fba7-e72d-4479-ab36-0bbf9f294d22", "tag": "42168f45-7a03-471a-b163-85fef4b32faa"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:39.768419 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-8c770bb6-ee47-42d9-981f-c194de798c57 req-614c78e6-f3c1-48d1-b441-441063f979b7 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:39.769354 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-8c770bb6-ee47-42d9-981f-c194de798c57 req-614c78e6-f3c1-48d1-b441-441063f979b7 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:39.782606 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-8c770bb6-ee47-42d9-981f-c194de798c57 req-614c78e6-f3c1-48d1-b441-441063f979b7 service nova] Creating event network-changed:42168f45-7a03-471a-b163-85fef4b32faa for instance 6e75fba7-e72d-4479-ab36-0bbf9f294d22 on hv-cinder-84949 Jul 18 10:53:39.791646 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-8c770bb6-ee47-42d9-981f-c194de798c57 req-614c78e6-f3c1-48d1-b441-441063f979b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039500 Jul 18 10:53:39.793002 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 393/808] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:40.267364 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-240029db-88c4-469e-a859-3c56ed663d30 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:40.268046 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-240029db-88c4-469e-a859-3c56ed663d30 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:40.282121 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-240029db-88c4-469e-a859-3c56ed663d30 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:40.283901 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-240029db-88c4-469e-a859-3c56ed663d30 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:40.283901 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-240029db-88c4-469e-a859-3c56ed663d30 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:40.283901 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-240029db-88c4-469e-a859-3c56ed663d30 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:40.494384 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-240029db-88c4-469e-a859-3c56ed663d30 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:40.503548 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-240029db-88c4-469e-a859-3c56ed663d30 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.240105 Jul 18 10:53:40.515920 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 416/809] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:40 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:40.611355 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-153200b0-a20a-47f5-8c2d-ee49de4ab53a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:40.613385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-153200b0-a20a-47f5-8c2d-ee49de4ab53a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:40.633376 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-153200b0-a20a-47f5-8c2d-ee49de4ab53a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:40.641737 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-153200b0-a20a-47f5-8c2d-ee49de4ab53a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:40.644083 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-153200b0-a20a-47f5-8c2d-ee49de4ab53a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:40.645176 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-153200b0-a20a-47f5-8c2d-ee49de4ab53a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:40.654789 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:40.691896 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-769fd427-8762-4667-ba1e-80d93a97746e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:40.692412 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-769fd427-8762-4667-ba1e-80d93a97746e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:40.703057 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-769fd427-8762-4667-ba1e-80d93a97746e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:40.711538 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-769fd427-8762-4667-ba1e-80d93a97746e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:40.712723 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-769fd427-8762-4667-ba1e-80d93a97746e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:40.713461 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-769fd427-8762-4667-ba1e-80d93a97746e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:40.733689 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-769fd427-8762-4667-ba1e-80d93a97746e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] HTTP exception thrown: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-769fd427-8762-4667-ba1e-80d93a97746e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Request method failure captured: Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: DELETE /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c HTTP/1.1 Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To1mq42Ndp7G5x96udz53cuzwL6rrizGEn7J54kIiI6bCBpM4QEifJN_jwy6kTx_0fXUcSEJkSlsI-UlpNR0WtCjid5hxedN7cOliEvOxhjD294gI8VWpwLOKlkBv6m-Z7iZlLisxYQ1hzNN67IJH-BGYcXhQ90dkJTv-nSnjs9eSM Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: f32dc706424247d0ac1dc7a6aa633107 Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:53:40.735660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:53:40.737073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:53:40.737073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:53:40.737073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: f32dc706424247d0ac1dc7a6aa633107 Jul 18 10:53:40.737073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:53:40.737073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeTestJSON-528647951-project Jul 18 10:53:40.737073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:53:40.737073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:53:40.737073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 3dbb489073d94425ad1a1b350768c428 Jul 18 10:53:40.737073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeTestJSON-528647951-project Jul 18 10:53:40.737073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:53:40.737073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. Jul 18 10:53:40.737073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '0f96ccdd-67b5-403c-a3b9-8022e271690c'} Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:40.737810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. Jul 18 10:53:40.739025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:40.745309 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-769fd427-8762-4667-ba1e-80d93a97746e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Returning 404 to user: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:40.746365 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-769fd427-8762-4667-ba1e-80d93a97746e tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 404 len: 111 microversion: 2.1 time: 0.059115 Jul 18 10:53:40.748117 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 417/810] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:53:40 2022] DELETE /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:53:40.756997 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-008bf464-c632-4b18-b4fb-14c6298e5daf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:40.772028 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-008bf464-c632-4b18-b4fb-14c6298e5daf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] [instance: 0f96ccdd-67b5-403c-a3b9-8022e271690c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:40.782662 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-008bf464-c632-4b18-b4fb-14c6298e5daf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:40.783374 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-008bf464-c632-4b18-b4fb-14c6298e5daf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:40.784369 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-008bf464-c632-4b18-b4fb-14c6298e5daf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:40.785007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-008bf464-c632-4b18-b4fb-14c6298e5daf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:40.824327 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-008bf464-c632-4b18-b4fb-14c6298e5daf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] HTTP exception thrown: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-008bf464-c632-4b18-b4fb-14c6298e5daf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Request method failure captured: Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c HTTP/1.1 Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To1mq42Ndp7G5x96udz53cuzwL6rrizGEn7J54kIiI6bCBpM4QEifJN_jwy6kTx_0fXUcSEJkSlsI-UlpNR0WtCjid5hxedN7cOliEvOxhjD294gI8VWpwLOKlkBv6m-Z7iZlLisxYQ1hzNN67IJH-BGYcXhQ90dkJTv-nSnjs9eSM Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: f32dc706424247d0ac1dc7a6aa633107 Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:53:40.826405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:53:40.827826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f32dc706424247d0ac1dc7a6aa633107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:53:40.827826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:53:40.827826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: f32dc706424247d0ac1dc7a6aa633107 Jul 18 10:53:40.827826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-528647951 Jul 18 10:53:40.827826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeTestJSON-528647951-project Jul 18 10:53:40.827826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:53:40.827826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:53:40.827826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 3dbb489073d94425ad1a1b350768c428 Jul 18 10:53:40.827826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeTestJSON-528647951-project Jul 18 10:53:40.827826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:53:40.827826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. Jul 18 10:53:40.827826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '0f96ccdd-67b5-403c-a3b9-8022e271690c'} Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:40.828539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. Jul 18 10:53:40.829898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:53:40.832579 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-008bf464-c632-4b18-b4fb-14c6298e5daf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] Returning 404 to user: Instance 0f96ccdd-67b5-403c-a3b9-8022e271690c could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:40.835627 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-008bf464-c632-4b18-b4fb-14c6298e5daf tempest-AttachVolumeTestJSON-528647951 tempest-AttachVolumeTestJSON-528647951-project] 10.222.0.49 "GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c" status: 404 len: 111 microversion: 2.1 time: 0.083492 Jul 18 10:53:40.836844 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 418/811] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:40 2022] GET /compute/v2.1/servers/0f96ccdd-67b5-403c-a3b9-8022e271690c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:53:40.994139 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-153200b0-a20a-47f5-8c2d-ee49de4ab53a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:41.005751 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-153200b0-a20a-47f5-8c2d-ee49de4ab53a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:41.008922 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-153200b0-a20a-47f5-8c2d-ee49de4ab53a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:41.014114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-153200b0-a20a-47f5-8c2d-ee49de4ab53a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1738 microversion: 2.20 time: 0.407152 Jul 18 10:53:41.014772 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 394/812] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:40 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1738 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:41.523612 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-885d855f-d04b-424e-85a3-e707dfd343a2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:41.524228 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-885d855f-d04b-424e-85a3-e707dfd343a2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:41.533044 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-885d855f-d04b-424e-85a3-e707dfd343a2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:41.533767 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-885d855f-d04b-424e-85a3-e707dfd343a2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:41.534741 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-885d855f-d04b-424e-85a3-e707dfd343a2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:41.535355 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-885d855f-d04b-424e-85a3-e707dfd343a2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:41.864351 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-885d855f-d04b-424e-85a3-e707dfd343a2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:41.886519 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-885d855f-d04b-424e-85a3-e707dfd343a2 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.368222 Jul 18 10:53:41.887536 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 419/813] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:41 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:42.034323 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-cfb89283-b5f9-42d2-906a-a80ce71dfb60 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:42.034925 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-cfb89283-b5f9-42d2-906a-a80ce71dfb60 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:42.053077 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cfb89283-b5f9-42d2-906a-a80ce71dfb60 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:42.054422 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cfb89283-b5f9-42d2-906a-a80ce71dfb60 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:42.055429 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cfb89283-b5f9-42d2-906a-a80ce71dfb60 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:42.058539 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cfb89283-b5f9-42d2-906a-a80ce71dfb60 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:42.425923 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-cfb89283-b5f9-42d2-906a-a80ce71dfb60 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:42.440258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-cfb89283-b5f9-42d2-906a-a80ce71dfb60 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:42.442118 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-cfb89283-b5f9-42d2-906a-a80ce71dfb60 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:42.443856 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-cfb89283-b5f9-42d2-906a-a80ce71dfb60 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1738 microversion: 2.20 time: 0.415307 Jul 18 10:53:42.455463 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 395/814] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:42 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1738 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:42.905371 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-16d5d8fb-442a-4735-aa82-e37697824c95 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:42.906745 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-16d5d8fb-442a-4735-aa82-e37697824c95 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:42.915684 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-16d5d8fb-442a-4735-aa82-e37697824c95 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:42.916052 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-16d5d8fb-442a-4735-aa82-e37697824c95 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:42.917178 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-16d5d8fb-442a-4735-aa82-e37697824c95 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:42.917866 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-16d5d8fb-442a-4735-aa82-e37697824c95 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:42.921376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=100 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:43.284075 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-16d5d8fb-442a-4735-aa82-e37697824c95 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:43.293663 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-16d5d8fb-442a-4735-aa82-e37697824c95 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.392586 Jul 18 10:53:43.294264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 420/815] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:42 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:43.467679 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-0b150d51-1576-4216-9dc5-84f37376c5d8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:43.469623 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-0b150d51-1576-4216-9dc5-84f37376c5d8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:43.476009 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b150d51-1576-4216-9dc5-84f37376c5d8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:43.476448 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b150d51-1576-4216-9dc5-84f37376c5d8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:43.477256 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b150d51-1576-4216-9dc5-84f37376c5d8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:43.477696 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b150d51-1576-4216-9dc5-84f37376c5d8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:43.907763 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0b150d51-1576-4216-9dc5-84f37376c5d8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:43.926623 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0b150d51-1576-4216-9dc5-84f37376c5d8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:43.929664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0b150d51-1576-4216-9dc5-84f37376c5d8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:43.931482 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-0b150d51-1576-4216-9dc5-84f37376c5d8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1738 microversion: 2.20 time: 0.469118 Jul 18 10:53:43.955194 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 396/816] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:43 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1738 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:53:44.313176 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-252da9c3-d7cb-4111-937f-9ac11edf41db tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:44.314951 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-252da9c3-d7cb-4111-937f-9ac11edf41db tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:44.335731 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-252da9c3-d7cb-4111-937f-9ac11edf41db tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:44.336537 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-252da9c3-d7cb-4111-937f-9ac11edf41db tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:44.338850 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-252da9c3-d7cb-4111-937f-9ac11edf41db tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:44.339458 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-252da9c3-d7cb-4111-937f-9ac11edf41db tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:44.631746 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-252da9c3-d7cb-4111-937f-9ac11edf41db tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:44.641025 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-252da9c3-d7cb-4111-937f-9ac11edf41db tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.333025 Jul 18 10:53:44.642129 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 421/817] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:44 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:44.954853 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2e08325b-5521-412d-b8e5-ce1869cf7e2a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:44.956114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2e08325b-5521-412d-b8e5-ce1869cf7e2a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:44.966717 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2e08325b-5521-412d-b8e5-ce1869cf7e2a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:44.967196 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2e08325b-5521-412d-b8e5-ce1869cf7e2a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:44.968005 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2e08325b-5521-412d-b8e5-ce1869cf7e2a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:44.968492 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2e08325b-5521-412d-b8e5-ce1869cf7e2a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:45.175372 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-2e08325b-5521-412d-b8e5-ce1869cf7e2a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:45.184467 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-2e08325b-5521-412d-b8e5-ce1869cf7e2a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:45.186051 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-2e08325b-5521-412d-b8e5-ce1869cf7e2a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:45.187225 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2e08325b-5521-412d-b8e5-ce1869cf7e2a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1738 microversion: 2.20 time: 0.240092 Jul 18 10:53:45.187791 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 397/818] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:44 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:45.659449 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a9fbb129-1d9f-4669-a677-4b8511eca6bf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:45.660231 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a9fbb129-1d9f-4669-a677-4b8511eca6bf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:45.667494 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a9fbb129-1d9f-4669-a677-4b8511eca6bf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:45.668012 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a9fbb129-1d9f-4669-a677-4b8511eca6bf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:45.668994 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a9fbb129-1d9f-4669-a677-4b8511eca6bf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:45.669495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a9fbb129-1d9f-4669-a677-4b8511eca6bf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:45.829738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a9fbb129-1d9f-4669-a677-4b8511eca6bf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:45.838762 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a9fbb129-1d9f-4669-a677-4b8511eca6bf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1569 microversion: 2.1 time: 0.183137 Jul 18 10:53:45.839361 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 422/819] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:45 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:45.856613 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-132af4bb-4a38-475f-a652-e33456d1b893 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:45.857591 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-132af4bb-4a38-475f-a652-e33456d1b893 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:45.869290 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-132af4bb-4a38-475f-a652-e33456d1b893 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:45.869838 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-132af4bb-4a38-475f-a652-e33456d1b893 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:45.870699 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-132af4bb-4a38-475f-a652-e33456d1b893 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:45.871357 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-132af4bb-4a38-475f-a652-e33456d1b893 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:46.211100 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a92396d4-8298-4868-b841-f4069e3c3986 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:46.211832 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a92396d4-8298-4868-b841-f4069e3c3986 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:46.235329 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a92396d4-8298-4868-b841-f4069e3c3986 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:46.236522 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a92396d4-8298-4868-b841-f4069e3c3986 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:46.239029 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a92396d4-8298-4868-b841-f4069e3c3986 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:46.240717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a92396d4-8298-4868-b841-f4069e3c3986 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:46.288341 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-132af4bb-4a38-475f-a652-e33456d1b893 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "POST /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354/action" status: 202 len: 0 microversion: 2.1 time: 0.435112 Jul 18 10:53:46.296051 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 398/820] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 18 10:53:45 2022] POST /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 10:53:46.334382 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3f82eceb-dc6f-476c-8bab-7cea2511487d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:46.345981 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3f82eceb-dc6f-476c-8bab-7cea2511487d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:46.360023 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3f82eceb-dc6f-476c-8bab-7cea2511487d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:46.361266 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3f82eceb-dc6f-476c-8bab-7cea2511487d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:46.362927 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3f82eceb-dc6f-476c-8bab-7cea2511487d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:46.363879 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3f82eceb-dc6f-476c-8bab-7cea2511487d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:46.576244 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a92396d4-8298-4868-b841-f4069e3c3986 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:46.586924 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a92396d4-8298-4868-b841-f4069e3c3986 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:46.589170 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a92396d4-8298-4868-b841-f4069e3c3986 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:46.590698 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a92396d4-8298-4868-b841-f4069e3c3986 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1720 microversion: 2.20 time: 0.384773 Jul 18 10:53:46.591973 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 423/821] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:46 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1720 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:46.646753 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3f82eceb-dc6f-476c-8bab-7cea2511487d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:46.656020 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3f82eceb-dc6f-476c-8bab-7cea2511487d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1517 microversion: 2.1 time: 0.347098 Jul 18 10:53:46.656853 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 399/822] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:46 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1517 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:47.059087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-a923070e-6e73-40fa-8c50-5434c0cbbbae req-ca76643d-f9a5-427b-a5a7-63c0f18a92e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1b361f-a048-4231-8c87-b3b27c478f7d", "name": "network-vif-unplugged", "status": "completed", "tag": "e168237a-b0b4-42cb-8c89-d5ade5d9cf57"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:47.059087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-a923070e-6e73-40fa-8c50-5434c0cbbbae req-ca76643d-f9a5-427b-a5a7-63c0f18a92e8 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:47.059087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-a923070e-6e73-40fa-8c50-5434c0cbbbae req-ca76643d-f9a5-427b-a5a7-63c0f18a92e8 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:47.059087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-a923070e-6e73-40fa-8c50-5434c0cbbbae req-ca76643d-f9a5-427b-a5a7-63c0f18a92e8 service nova] Creating event network-vif-unplugged:e168237a-b0b4-42cb-8c89-d5ade5d9cf57 for instance 4f1b361f-a048-4231-8c87-b3b27c478f7d on hv-cinder-84949 Jul 18 10:53:47.062478 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-a923070e-6e73-40fa-8c50-5434c0cbbbae req-ca76643d-f9a5-427b-a5a7-63c0f18a92e8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040695 Jul 18 10:53:47.062478 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 424/823] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:47.614897 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-076511dc-ece8-4c84-9208-b76f7dabdc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:47.615760 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-076511dc-ece8-4c84-9208-b76f7dabdc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:47.625196 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-076511dc-ece8-4c84-9208-b76f7dabdc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:47.625657 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-076511dc-ece8-4c84-9208-b76f7dabdc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:47.626448 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-076511dc-ece8-4c84-9208-b76f7dabdc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:47.626880 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-076511dc-ece8-4c84-9208-b76f7dabdc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:47.679388 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-aed7903d-41be-40fb-8679-a86b1fac6b03 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:47.680292 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-aed7903d-41be-40fb-8679-a86b1fac6b03 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:47.686911 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-aed7903d-41be-40fb-8679-a86b1fac6b03 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:47.688882 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-aed7903d-41be-40fb-8679-a86b1fac6b03 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:47.688882 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-aed7903d-41be-40fb-8679-a86b1fac6b03 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:47.688882 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-aed7903d-41be-40fb-8679-a86b1fac6b03 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:47.838046 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-076511dc-ece8-4c84-9208-b76f7dabdc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:47.847702 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-076511dc-ece8-4c84-9208-b76f7dabdc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:47.850467 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-076511dc-ece8-4c84-9208-b76f7dabdc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:47.851683 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-076511dc-ece8-4c84-9208-b76f7dabdc19 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1720 microversion: 2.20 time: 0.241080 Jul 18 10:53:47.852764 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 400/824] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:47 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1720 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:53:47.892339 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-aed7903d-41be-40fb-8679-a86b1fac6b03 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:47.895284 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-aed7903d-41be-40fb-8679-a86b1fac6b03 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1517 microversion: 2.1 time: 0.220672 Jul 18 10:53:47.896981 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 425/825] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:47 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1517 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:48.873215 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-361f1b3a-2b02-4593-bbff-d798c870e72d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:48.880586 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-361f1b3a-2b02-4593-bbff-d798c870e72d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:48.891214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-361f1b3a-2b02-4593-bbff-d798c870e72d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:48.891678 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-361f1b3a-2b02-4593-bbff-d798c870e72d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:48.892637 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-361f1b3a-2b02-4593-bbff-d798c870e72d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:48.893111 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-361f1b3a-2b02-4593-bbff-d798c870e72d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:48.916707 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-36205b62-5331-4209-b77a-edb1c7f6b19a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:48.919098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-36205b62-5331-4209-b77a-edb1c7f6b19a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:48.927419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-36205b62-5331-4209-b77a-edb1c7f6b19a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:48.929229 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-36205b62-5331-4209-b77a-edb1c7f6b19a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:48.930552 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-36205b62-5331-4209-b77a-edb1c7f6b19a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:48.930998 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-36205b62-5331-4209-b77a-edb1c7f6b19a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:49.134454 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-361f1b3a-2b02-4593-bbff-d798c870e72d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:49.143804 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-361f1b3a-2b02-4593-bbff-d798c870e72d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:49.145326 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-361f1b3a-2b02-4593-bbff-d798c870e72d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:49.147021 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-361f1b3a-2b02-4593-bbff-d798c870e72d tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1720 microversion: 2.20 time: 0.279400 Jul 18 10:53:49.148060 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 401/826] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:48 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1720 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:49.153135 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-856fb05a-c4c2-4942-b818-71bd4991e50a req-7b300695-395c-4a20-a5a7-c787d5ba3909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dab0fce-91d6-4e37-970c-02ba8250d354", "name": "network-vif-unplugged", "status": "completed", "tag": "251fff9b-71a7-49e1-bd58-5b46a671f255"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:49.162139 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-856fb05a-c4c2-4942-b818-71bd4991e50a req-7b300695-395c-4a20-a5a7-c787d5ba3909 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:49.162666 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-856fb05a-c4c2-4942-b818-71bd4991e50a req-7b300695-395c-4a20-a5a7-c787d5ba3909 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:49.172652 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-36205b62-5331-4209-b77a-edb1c7f6b19a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:49.174840 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.compute.server_external_events [req-856fb05a-c4c2-4942-b818-71bd4991e50a req-7b300695-395c-4a20-a5a7-c787d5ba3909 service nova] Unable to find a host for instance 3dab0fce-91d6-4e37-970c-02ba8250d354. Dropping event network-vif-unplugged {{(pid=125005) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 10:53:49.175713 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-856fb05a-c4c2-4942-b818-71bd4991e50a req-7b300695-395c-4a20-a5a7-c787d5ba3909 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026479 Jul 18 10:53:49.176650 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 402/827] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 10:53:49.178714 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-36205b62-5331-4209-b77a-edb1c7f6b19a tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1517 microversion: 2.1 time: 0.268093 Jul 18 10:53:49.180822 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 426/828] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:48 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1517 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:50.166818 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e5d5f4a8-d540-48e6-bf0c-041dab794cc1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:50.167432 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e5d5f4a8-d540-48e6-bf0c-041dab794cc1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:50.174042 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e5d5f4a8-d540-48e6-bf0c-041dab794cc1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:50.174489 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e5d5f4a8-d540-48e6-bf0c-041dab794cc1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:50.175245 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e5d5f4a8-d540-48e6-bf0c-041dab794cc1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:50.175680 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e5d5f4a8-d540-48e6-bf0c-041dab794cc1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:50.196940 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-316569a5-9d8a-4b39-b21c-9a501ac66422 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:50.198103 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-316569a5-9d8a-4b39-b21c-9a501ac66422 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:50.204971 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-316569a5-9d8a-4b39-b21c-9a501ac66422 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:50.205802 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-316569a5-9d8a-4b39-b21c-9a501ac66422 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:50.206741 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-316569a5-9d8a-4b39-b21c-9a501ac66422 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:50.207441 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-316569a5-9d8a-4b39-b21c-9a501ac66422 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:50.416466 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-316569a5-9d8a-4b39-b21c-9a501ac66422 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:50.419852 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e5d5f4a8-d540-48e6-bf0c-041dab794cc1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:50.424899 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-316569a5-9d8a-4b39-b21c-9a501ac66422 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1519 microversion: 2.1 time: 0.233102 Jul 18 10:53:50.425588 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 427/829] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:50 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:50.429740 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e5d5f4a8-d540-48e6-bf0c-041dab794cc1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:50.432210 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e5d5f4a8-d540-48e6-bf0c-041dab794cc1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:50.435285 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e5d5f4a8-d540-48e6-bf0c-041dab794cc1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1723 microversion: 2.20 time: 0.271374 Jul 18 10:53:50.440837 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 403/830] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:50 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:50.453643 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6d931df8-f082-4ff1-a315-f92ee37242a5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5395e60f-e004-4259-b48e-a8dfa48f6234"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:50.466771 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6d931df8-f082-4ff1-a315-f92ee37242a5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:50.466771 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6d931df8-f082-4ff1-a315-f92ee37242a5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:50.466771 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6d931df8-f082-4ff1-a315-f92ee37242a5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:50.466771 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6d931df8-f082-4ff1-a315-f92ee37242a5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:50.467496 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6d931df8-f082-4ff1-a315-f92ee37242a5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:51.446759 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-62d31b51-1c07-4375-97fa-90ea954003b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:51.447811 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-62d31b51-1c07-4375-97fa-90ea954003b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:51.456237 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-62d31b51-1c07-4375-97fa-90ea954003b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:51.456675 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-62d31b51-1c07-4375-97fa-90ea954003b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:51.457478 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-62d31b51-1c07-4375-97fa-90ea954003b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:51.458402 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-62d31b51-1c07-4375-97fa-90ea954003b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:51.606675 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-62d31b51-1c07-4375-97fa-90ea954003b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:51.615000 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-62d31b51-1c07-4375-97fa-90ea954003b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.174420 Jul 18 10:53:51.615693 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 404/831] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:51 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:52.356917 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6d931df8-f082-4ff1-a315-f92ee37242a5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "POST /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.907794 Jul 18 10:53:52.358050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 428/832] 10.222.0.49 () {62 vars in 1363 bytes} [Mon Jul 18 10:53:50 2022] POST /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d/os-volume_attachments => generated 188 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:53:52.486500 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d6a0a008-56e5-4556-bd7e-d92f55bcb257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:52.487101 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d6a0a008-56e5-4556-bd7e-d92f55bcb257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:52.494258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d6a0a008-56e5-4556-bd7e-d92f55bcb257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:52.494713 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d6a0a008-56e5-4556-bd7e-d92f55bcb257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:52.495508 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d6a0a008-56e5-4556-bd7e-d92f55bcb257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:52.495964 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d6a0a008-56e5-4556-bd7e-d92f55bcb257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:52.633955 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d252ec91-6c91-4e79-9060-4510f667a2c4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:52.634710 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d252ec91-6c91-4e79-9060-4510f667a2c4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:52.643537 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d252ec91-6c91-4e79-9060-4510f667a2c4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:52.643978 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d252ec91-6c91-4e79-9060-4510f667a2c4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:52.644760 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d252ec91-6c91-4e79-9060-4510f667a2c4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:52.645208 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d252ec91-6c91-4e79-9060-4510f667a2c4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:52.798978 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d252ec91-6c91-4e79-9060-4510f667a2c4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:52.819801 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d252ec91-6c91-4e79-9060-4510f667a2c4 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.188471 Jul 18 10:53:52.819801 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 429/833] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:52 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:53.242714 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d6a0a008-56e5-4556-bd7e-d92f55bcb257 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d/os-volume_attachments/5395e60f-e004-4259-b48e-a8dfa48f6234" status: 202 len: 0 microversion: 2.20 time: 0.760132 Jul 18 10:53:53.243458 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 405/834] 10.222.0.49 () {60 vars in 1456 bytes} [Mon Jul 18 10:53:52 2022] DELETE /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d/os-volume_attachments/5395e60f-e004-4259-b48e-a8dfa48f6234 => generated 0 bytes in 762 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:53:53.310628 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-c32b82ce-72cf-4bd7-a3ff-fdd48f0ebedf tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:53.311199 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-c32b82ce-72cf-4bd7-a3ff-fdd48f0ebedf tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:53.319243 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c32b82ce-72cf-4bd7-a3ff-fdd48f0ebedf tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:53.319634 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c32b82ce-72cf-4bd7-a3ff-fdd48f0ebedf tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:53.320536 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c32b82ce-72cf-4bd7-a3ff-fdd48f0ebedf tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:53.321015 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c32b82ce-72cf-4bd7-a3ff-fdd48f0ebedf tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:53.651452 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-c32b82ce-72cf-4bd7-a3ff-fdd48f0ebedf tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "POST /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d/action" status: 202 len: 0 microversion: 2.20 time: 0.345000 Jul 18 10:53:53.652328 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 430/835] 10.222.0.49 () {62 vars in 1318 bytes} [Mon Jul 18 10:53:53 2022] POST /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:53:53.660484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3a76d6bf-0d09-449f-8941-a25e15999ae5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:53.662998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3a76d6bf-0d09-449f-8941-a25e15999ae5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:53.671792 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3a76d6bf-0d09-449f-8941-a25e15999ae5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:53.672332 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3a76d6bf-0d09-449f-8941-a25e15999ae5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:53.673216 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3a76d6bf-0d09-449f-8941-a25e15999ae5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:53.673737 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3a76d6bf-0d09-449f-8941-a25e15999ae5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:53.813027 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-89fb803e-96e9-4a7a-bbac-6b8393ca17aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:53.813536 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-89fb803e-96e9-4a7a-bbac-6b8393ca17aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:53.820675 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-89fb803e-96e9-4a7a-bbac-6b8393ca17aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:53.827103 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-89fb803e-96e9-4a7a-bbac-6b8393ca17aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:53.827103 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-89fb803e-96e9-4a7a-bbac-6b8393ca17aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:53.827103 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-89fb803e-96e9-4a7a-bbac-6b8393ca17aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:53.834310 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3a76d6bf-0d09-449f-8941-a25e15999ae5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:53.846131 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3a76d6bf-0d09-449f-8941-a25e15999ae5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:53.848060 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3a76d6bf-0d09-449f-8941-a25e15999ae5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:53.850130 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3a76d6bf-0d09-449f-8941-a25e15999ae5 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1671 microversion: 2.20 time: 0.193837 Jul 18 10:53:53.850870 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 406/836] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:53 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1671 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:53.859290 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-89fb803e-96e9-4a7a-bbac-6b8393ca17aa tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543/ips" status: 200 len: 149 microversion: 2.1 time: 0.044236 Jul 18 10:53:53.859290 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 431/837] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 18 10:53:53 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:53.859901 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-7ee75233-db3c-4c9d-b3a9-30363f397f87 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:53.860530 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-7ee75233-db3c-4c9d-b3a9-30363f397f87 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:53.867188 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ee75233-db3c-4c9d-b3a9-30363f397f87 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:53.867641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ee75233-db3c-4c9d-b3a9-30363f397f87 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:53.868426 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ee75233-db3c-4c9d-b3a9-30363f397f87 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:53.868892 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ee75233-db3c-4c9d-b3a9-30363f397f87 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:54.031812 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7ee75233-db3c-4c9d-b3a9-30363f397f87 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:54.040631 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-7ee75233-db3c-4c9d-b3a9-30363f397f87 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.185202 Jul 18 10:53:54.041458 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 432/838] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:53 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:54.870266 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-4b4c1320-c395-4215-abd4-007ecf2aeae9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:54.871023 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-4b4c1320-c395-4215-abd4-007ecf2aeae9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:54.877630 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4b4c1320-c395-4215-abd4-007ecf2aeae9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:54.878144 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4b4c1320-c395-4215-abd4-007ecf2aeae9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:54.878841 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4b4c1320-c395-4215-abd4-007ecf2aeae9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:54.879263 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4b4c1320-c395-4215-abd4-007ecf2aeae9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:55.048008 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4b4c1320-c395-4215-abd4-007ecf2aeae9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:55.057407 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:55.059915 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f00daf04-6b30-409c-9549-7666bfeab1f1 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:55.060537 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f00daf04-6b30-409c-9549-7666bfeab1f1 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:55.063655 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4b4c1320-c395-4215-abd4-007ecf2aeae9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:55.065292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4b4c1320-c395-4215-abd4-007ecf2aeae9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:55.066762 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-4b4c1320-c395-4215-abd4-007ecf2aeae9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1671 microversion: 2.20 time: 0.200785 Jul 18 10:53:55.067918 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f00daf04-6b30-409c-9549-7666bfeab1f1 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:55.068291 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 407/839] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:54 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1671 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:55.068498 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f00daf04-6b30-409c-9549-7666bfeab1f1 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:55.069567 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f00daf04-6b30-409c-9549-7666bfeab1f1 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:55.070007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f00daf04-6b30-409c-9549-7666bfeab1f1 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:55.216076 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f00daf04-6b30-409c-9549-7666bfeab1f1 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:55.225338 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f00daf04-6b30-409c-9549-7666bfeab1f1 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.170331 Jul 18 10:53:55.226039 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 433/840] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:55 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:56.094686 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9b6148ae-239f-49e7-8a91-b8f7811b4aa9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:56.095279 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-9b6148ae-239f-49e7-8a91-b8f7811b4aa9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:56.103788 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9b6148ae-239f-49e7-8a91-b8f7811b4aa9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:56.104233 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9b6148ae-239f-49e7-8a91-b8f7811b4aa9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:56.105044 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9b6148ae-239f-49e7-8a91-b8f7811b4aa9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:56.105479 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9b6148ae-239f-49e7-8a91-b8f7811b4aa9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:56.242863 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-7dd4a6ed-8bcc-4af9-9671-e627f405c571 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:56.243464 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-7dd4a6ed-8bcc-4af9-9671-e627f405c571 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:56.248114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9b6148ae-239f-49e7-8a91-b8f7811b4aa9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:56.250154 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7dd4a6ed-8bcc-4af9-9671-e627f405c571 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:56.250594 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7dd4a6ed-8bcc-4af9-9671-e627f405c571 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:56.251520 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7dd4a6ed-8bcc-4af9-9671-e627f405c571 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:56.251950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7dd4a6ed-8bcc-4af9-9671-e627f405c571 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:56.257128 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:56.261068 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9b6148ae-239f-49e7-8a91-b8f7811b4aa9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:56.262625 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9b6148ae-239f-49e7-8a91-b8f7811b4aa9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:56.263797 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9b6148ae-239f-49e7-8a91-b8f7811b4aa9 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1673 microversion: 2.20 time: 0.173127 Jul 18 10:53:56.265062 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 408/841] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:56 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:56.393919 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7dd4a6ed-8bcc-4af9-9671-e627f405c571 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:56.402821 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-7dd4a6ed-8bcc-4af9-9671-e627f405c571 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.163887 Jul 18 10:53:56.403406 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 434/842] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:56 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:57.289256 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a7e8320f-7866-42f9-953d-43beac9ab083 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:57.289994 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a7e8320f-7866-42f9-953d-43beac9ab083 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:57.296984 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a7e8320f-7866-42f9-953d-43beac9ab083 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:57.297552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a7e8320f-7866-42f9-953d-43beac9ab083 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:57.298419 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a7e8320f-7866-42f9-953d-43beac9ab083 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:57.298856 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a7e8320f-7866-42f9-953d-43beac9ab083 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:57.423949 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a58e5333-8df4-485d-a4e9-a6b956bd3c8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:57.425095 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a58e5333-8df4-485d-a4e9-a6b956bd3c8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:57.439305 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a58e5333-8df4-485d-a4e9-a6b956bd3c8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:57.445897 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a58e5333-8df4-485d-a4e9-a6b956bd3c8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:57.445897 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a58e5333-8df4-485d-a4e9-a6b956bd3c8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:57.445897 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a58e5333-8df4-485d-a4e9-a6b956bd3c8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:57.472114 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a7e8320f-7866-42f9-953d-43beac9ab083 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:57.484769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a7e8320f-7866-42f9-953d-43beac9ab083 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:57.486733 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a7e8320f-7866-42f9-953d-43beac9ab083 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:57.488318 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a7e8320f-7866-42f9-953d-43beac9ab083 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.203145 Jul 18 10:53:57.490566 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 409/843] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:57 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:53:57.632669 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a58e5333-8df4-485d-a4e9-a6b956bd3c8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:57.641614 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a58e5333-8df4-485d-a4e9-a6b956bd3c8f tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.223325 Jul 18 10:53:57.643861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 435/844] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:57 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:58.243360 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-ed0566c9-0f0a-4a3c-8184-fa8b9d7d784c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcaa7f10-3661-4f0c-a7f7-c1659ead80ca"}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:58.244533 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-ed0566c9-0f0a-4a3c-8184-fa8b9d7d784c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:58.246444 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:58.251488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ed0566c9-0f0a-4a3c-8184-fa8b9d7d784c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:58.251929 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ed0566c9-0f0a-4a3c-8184-fa8b9d7d784c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:58.252706 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ed0566c9-0f0a-4a3c-8184-fa8b9d7d784c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:58.253174 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-ed0566c9-0f0a-4a3c-8184-fa8b9d7d784c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:58.509781 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-243d3e25-79f0-4a4f-8695-d3e803adab6b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:58.510403 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-243d3e25-79f0-4a4f-8695-d3e803adab6b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:58.517528 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-243d3e25-79f0-4a4f-8695-d3e803adab6b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:58.517987 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-243d3e25-79f0-4a4f-8695-d3e803adab6b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:58.518769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-243d3e25-79f0-4a4f-8695-d3e803adab6b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:58.519207 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-243d3e25-79f0-4a4f-8695-d3e803adab6b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:58.667513 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-243d3e25-79f0-4a4f-8695-d3e803adab6b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:58.675554 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-243d3e25-79f0-4a4f-8695-d3e803adab6b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:58.689408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-243d3e25-79f0-4a4f-8695-d3e803adab6b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:58.689408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-243d3e25-79f0-4a4f-8695-d3e803adab6b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.173532 Jul 18 10:53:58.689408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 436/845] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:58 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:53:58.689408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-10526442-7095-4bd2-a1f1-ed7111aaca9b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:58.689840 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-10526442-7095-4bd2-a1f1-ed7111aaca9b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:58.691415 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-10526442-7095-4bd2-a1f1-ed7111aaca9b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:58.691864 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-10526442-7095-4bd2-a1f1-ed7111aaca9b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:58.693386 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-10526442-7095-4bd2-a1f1-ed7111aaca9b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:58.693818 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-10526442-7095-4bd2-a1f1-ed7111aaca9b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:58.840032 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-10526442-7095-4bd2-a1f1-ed7111aaca9b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:58.851858 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-10526442-7095-4bd2-a1f1-ed7111aaca9b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.171865 Jul 18 10:53:58.852757 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 437/846] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:58 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:59.697065 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5ce70ab3-a1bd-4848-99c4-2a8fa195c808 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:59.697984 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-5ce70ab3-a1bd-4848-99c4-2a8fa195c808 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:59.704550 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5ce70ab3-a1bd-4848-99c4-2a8fa195c808 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:59.705078 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5ce70ab3-a1bd-4848-99c4-2a8fa195c808 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:59.705847 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5ce70ab3-a1bd-4848-99c4-2a8fa195c808 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:59.706277 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5ce70ab3-a1bd-4848-99c4-2a8fa195c808 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:59.857526 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-5ce70ab3-a1bd-4848-99c4-2a8fa195c808 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:59.866709 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-5ce70ab3-a1bd-4848-99c4-2a8fa195c808 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:59.870382 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-5ce70ab3-a1bd-4848-99c4-2a8fa195c808 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:59.870382 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5ce70ab3-a1bd-4848-99c4-2a8fa195c808 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.176855 Jul 18 10:53:59.870700 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 438/847] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:53:59 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:53:59.875246 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9e66f71a-f681-4c6c-9f41-7adb11f67481 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:59.875850 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9e66f71a-f681-4c6c-9f41-7adb11f67481 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:59.882999 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e66f71a-f681-4c6c-9f41-7adb11f67481 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:59.883452 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e66f71a-f681-4c6c-9f41-7adb11f67481 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:59.884230 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e66f71a-f681-4c6c-9f41-7adb11f67481 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:59.884667 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e66f71a-f681-4c6c-9f41-7adb11f67481 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:59.972491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-ed0566c9-0f0a-4a3c-8184-fa8b9d7d784c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "POST /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.732904 Jul 18 10:53:59.973277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 410/848] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 18 10:53:58 2022] POST /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543/os-volume_attachments => generated 194 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:54:00.033110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9e66f71a-f681-4c6c-9f41-7adb11f67481 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:00.040841 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9e66f71a-f681-4c6c-9f41-7adb11f67481 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.169153 Jul 18 10:54:00.041420 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 439/849] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:59 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:00.890996 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3b0615ae-05d5-4426-9ddb-5eed241d4c86 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:00.892662 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3b0615ae-05d5-4426-9ddb-5eed241d4c86 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:00.900655 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3b0615ae-05d5-4426-9ddb-5eed241d4c86 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:00.901442 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3b0615ae-05d5-4426-9ddb-5eed241d4c86 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:00.902408 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3b0615ae-05d5-4426-9ddb-5eed241d4c86 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:00.903008 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3b0615ae-05d5-4426-9ddb-5eed241d4c86 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:01.059259 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b050a9b8-ac63-4985-af02-c12d0843f5e5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:01.059901 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b050a9b8-ac63-4985-af02-c12d0843f5e5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:01.072744 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3b0615ae-05d5-4426-9ddb-5eed241d4c86 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:01.087034 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3b0615ae-05d5-4426-9ddb-5eed241d4c86 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:01.090415 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b050a9b8-ac63-4985-af02-c12d0843f5e5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:01.090623 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3b0615ae-05d5-4426-9ddb-5eed241d4c86 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:01.090984 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b050a9b8-ac63-4985-af02-c12d0843f5e5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:01.091858 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3b0615ae-05d5-4426-9ddb-5eed241d4c86 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.205670 Jul 18 10:54:01.092254 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b050a9b8-ac63-4985-af02-c12d0843f5e5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:01.093011 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b050a9b8-ac63-4985-af02-c12d0843f5e5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:01.109047 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 411/850] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:00 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:54:01.279652 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-b050a9b8-ac63-4985-af02-c12d0843f5e5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:01.288613 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b050a9b8-ac63-4985-af02-c12d0843f5e5 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.233861 Jul 18 10:54:01.289281 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 440/851] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:01 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:54:02.116534 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3f178c8d-476e-47da-b925-4194f32f814b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:02.117306 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3f178c8d-476e-47da-b925-4194f32f814b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:02.124934 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3f178c8d-476e-47da-b925-4194f32f814b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:02.125522 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3f178c8d-476e-47da-b925-4194f32f814b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:02.126402 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3f178c8d-476e-47da-b925-4194f32f814b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:02.126931 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3f178c8d-476e-47da-b925-4194f32f814b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:02.306006 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3f178c8d-476e-47da-b925-4194f32f814b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:02.311241 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-80a84f08-7a48-42d6-8ae1-444ffa724a2c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:02.312208 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-80a84f08-7a48-42d6-8ae1-444ffa724a2c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:02.316281 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3f178c8d-476e-47da-b925-4194f32f814b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:02.318299 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3f178c8d-476e-47da-b925-4194f32f814b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:02.320111 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3f178c8d-476e-47da-b925-4194f32f814b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.207925 Jul 18 10:54:02.320459 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 412/852] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:02 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:54:02.324585 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-80a84f08-7a48-42d6-8ae1-444ffa724a2c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:02.325171 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-80a84f08-7a48-42d6-8ae1-444ffa724a2c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:02.326219 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-80a84f08-7a48-42d6-8ae1-444ffa724a2c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:02.326680 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-80a84f08-7a48-42d6-8ae1-444ffa724a2c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:02.471793 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-80a84f08-7a48-42d6-8ae1-444ffa724a2c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:02.482672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-80a84f08-7a48-42d6-8ae1-444ffa724a2c tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.175638 Jul 18 10:54:02.486104 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 441/853] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:02 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:03.342556 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-cb6d8be3-a441-4285-9fe2-3fec3eda0bf6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:03.343771 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-cb6d8be3-a441-4285-9fe2-3fec3eda0bf6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:03.353633 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cb6d8be3-a441-4285-9fe2-3fec3eda0bf6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:03.354493 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cb6d8be3-a441-4285-9fe2-3fec3eda0bf6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:03.355542 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cb6d8be3-a441-4285-9fe2-3fec3eda0bf6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:03.356236 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-cb6d8be3-a441-4285-9fe2-3fec3eda0bf6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:03.500013 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ef91b2e0-f539-4f3b-9063-5019aee2640d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:03.501327 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ef91b2e0-f539-4f3b-9063-5019aee2640d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:03.511657 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ef91b2e0-f539-4f3b-9063-5019aee2640d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:03.514098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ef91b2e0-f539-4f3b-9063-5019aee2640d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:03.515563 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ef91b2e0-f539-4f3b-9063-5019aee2640d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:03.520984 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ef91b2e0-f539-4f3b-9063-5019aee2640d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:03.561764 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-cb6d8be3-a441-4285-9fe2-3fec3eda0bf6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:03.574990 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-cb6d8be3-a441-4285-9fe2-3fec3eda0bf6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:03.576948 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-cb6d8be3-a441-4285-9fe2-3fec3eda0bf6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:03.579109 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-cb6d8be3-a441-4285-9fe2-3fec3eda0bf6 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.242820 Jul 18 10:54:03.580074 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 413/854] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:03 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:54:03.747548 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ef91b2e0-f539-4f3b-9063-5019aee2640d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:03.756328 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ef91b2e0-f539-4f3b-9063-5019aee2640d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.260287 Jul 18 10:54:03.764917 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 442/855] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:03 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:04.601505 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-5f24035f-729c-4bdd-881c-cfbb0fd5d353 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:04.602863 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-5f24035f-729c-4bdd-881c-cfbb0fd5d353 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:04.610098 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5f24035f-729c-4bdd-881c-cfbb0fd5d353 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:04.610916 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5f24035f-729c-4bdd-881c-cfbb0fd5d353 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:04.611978 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5f24035f-729c-4bdd-881c-cfbb0fd5d353 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:04.612631 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-5f24035f-729c-4bdd-881c-cfbb0fd5d353 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:04.777024 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ccfe1ea2-8d62-4736-91cc-0257ecb16e45 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:04.778407 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ccfe1ea2-8d62-4736-91cc-0257ecb16e45 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:04.794594 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ccfe1ea2-8d62-4736-91cc-0257ecb16e45 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:04.795379 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ccfe1ea2-8d62-4736-91cc-0257ecb16e45 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:04.798098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ccfe1ea2-8d62-4736-91cc-0257ecb16e45 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:04.798877 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ccfe1ea2-8d62-4736-91cc-0257ecb16e45 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:04.869005 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5f24035f-729c-4bdd-881c-cfbb0fd5d353 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:04.896357 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5f24035f-729c-4bdd-881c-cfbb0fd5d353 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:04.908693 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-5f24035f-729c-4bdd-881c-cfbb0fd5d353 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:04.910149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-5f24035f-729c-4bdd-881c-cfbb0fd5d353 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.314060 Jul 18 10:54:04.910887 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 414/856] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:04 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:54:05.047411 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-d41dd486-6519-4f0d-9443-c45271020205 req-d4ea6b99-8a26-4d51-b586-224e97042ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dab0fce-91d6-4e37-970c-02ba8250d354", "name": "network-vif-plugged", "status": "completed", "tag": "251fff9b-71a7-49e1-bd58-5b46a671f255"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:54:05.064199 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-d41dd486-6519-4f0d-9443-c45271020205 req-d4ea6b99-8a26-4d51-b586-224e97042ec2 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:05.067753 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-d41dd486-6519-4f0d-9443-c45271020205 req-d4ea6b99-8a26-4d51-b586-224e97042ec2 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:05.092707 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-d41dd486-6519-4f0d-9443-c45271020205 req-d4ea6b99-8a26-4d51-b586-224e97042ec2 service nova] Creating event network-vif-plugged:251fff9b-71a7-49e1-bd58-5b46a671f255 for instance 3dab0fce-91d6-4e37-970c-02ba8250d354 on hv-cinder-84949 Jul 18 10:54:05.109240 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-d41dd486-6519-4f0d-9443-c45271020205 req-d4ea6b99-8a26-4d51-b586-224e97042ec2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070102 Jul 18 10:54:05.112726 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 415/857] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:05.119111 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ccfe1ea2-8d62-4736-91cc-0257ecb16e45 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:05.143889 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ccfe1ea2-8d62-4736-91cc-0257ecb16e45 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.370224 Jul 18 10:54:05.145203 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 443/858] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:04 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:06.052031 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-dab75b3d-8c93-4733-84a1-6513f54863a1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:06.052031 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-dab75b3d-8c93-4733-84a1-6513f54863a1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:06.052031 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-dab75b3d-8c93-4733-84a1-6513f54863a1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:06.052031 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-dab75b3d-8c93-4733-84a1-6513f54863a1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:06.053387 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-dab75b3d-8c93-4733-84a1-6513f54863a1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:06.053387 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-dab75b3d-8c93-4733-84a1-6513f54863a1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:06.116422 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-dab75b3d-8c93-4733-84a1-6513f54863a1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:06.146057 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-dab75b3d-8c93-4733-84a1-6513f54863a1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:06.155562 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-dab75b3d-8c93-4733-84a1-6513f54863a1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:06.162779 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9c104396-388d-4d61-9db7-6b6c95c35ddc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:06.164204 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9c104396-388d-4d61-9db7-6b6c95c35ddc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:06.169752 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-dab75b3d-8c93-4733-84a1-6513f54863a1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.231446 Jul 18 10:54:06.185016 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 416/859] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:05 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:54:06.189530 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=76 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:06.191417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9c104396-388d-4d61-9db7-6b6c95c35ddc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:06.192537 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9c104396-388d-4d61-9db7-6b6c95c35ddc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:06.194026 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9c104396-388d-4d61-9db7-6b6c95c35ddc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:06.194635 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9c104396-388d-4d61-9db7-6b6c95c35ddc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:06.414885 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9c104396-388d-4d61-9db7-6b6c95c35ddc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:06.415975 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9c104396-388d-4d61-9db7-6b6c95c35ddc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.257292 Jul 18 10:54:06.417098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 444/860] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:06 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:07.205189 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-241a7ef2-3c19-4533-89a3-534302e5ae8c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:07.206613 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-241a7ef2-3c19-4533-89a3-534302e5ae8c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:07.236735 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-241a7ef2-3c19-4533-89a3-534302e5ae8c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:07.237239 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-241a7ef2-3c19-4533-89a3-534302e5ae8c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:07.238048 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-241a7ef2-3c19-4533-89a3-534302e5ae8c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:07.238512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-241a7ef2-3c19-4533-89a3-534302e5ae8c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:07.438191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2398ceda-ee29-4b23-9478-c59cf86427fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:07.440880 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2398ceda-ee29-4b23-9478-c59cf86427fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:07.451624 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2398ceda-ee29-4b23-9478-c59cf86427fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:07.452550 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2398ceda-ee29-4b23-9478-c59cf86427fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:07.453745 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2398ceda-ee29-4b23-9478-c59cf86427fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:07.458997 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2398ceda-ee29-4b23-9478-c59cf86427fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:07.553917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-241a7ef2-3c19-4533-89a3-534302e5ae8c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:07.567331 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-241a7ef2-3c19-4533-89a3-534302e5ae8c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:07.569086 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-241a7ef2-3c19-4533-89a3-534302e5ae8c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:07.570753 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-241a7ef2-3c19-4533-89a3-534302e5ae8c tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.371058 Jul 18 10:54:07.582444 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 417/861] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:07 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:54:07.683399 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2398ceda-ee29-4b23-9478-c59cf86427fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:07.694650 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2398ceda-ee29-4b23-9478-c59cf86427fc tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.263155 Jul 18 10:54:07.695179 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 445/862] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:07 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:08.595924 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-59c64418-fa9c-41f1-b177-710bee428a4b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:08.602130 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-59c64418-fa9c-41f1-b177-710bee428a4b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:08.618886 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-59c64418-fa9c-41f1-b177-710bee428a4b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:08.619601 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-59c64418-fa9c-41f1-b177-710bee428a4b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:08.621600 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-59c64418-fa9c-41f1-b177-710bee428a4b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:08.622408 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-59c64418-fa9c-41f1-b177-710bee428a4b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:08.716364 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-232f06f1-76d2-420a-aa9f-d7da480af9c9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:08.717306 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-232f06f1-76d2-420a-aa9f-d7da480af9c9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:08.766447 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-232f06f1-76d2-420a-aa9f-d7da480af9c9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:08.770285 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-232f06f1-76d2-420a-aa9f-d7da480af9c9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:08.776725 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-232f06f1-76d2-420a-aa9f-d7da480af9c9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:08.778520 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-232f06f1-76d2-420a-aa9f-d7da480af9c9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:08.862974 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-59c64418-fa9c-41f1-b177-710bee428a4b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:08.877722 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-59c64418-fa9c-41f1-b177-710bee428a4b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:08.880609 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-59c64418-fa9c-41f1-b177-710bee428a4b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:08.883556 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-59c64418-fa9c-41f1-b177-710bee428a4b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.297005 Jul 18 10:54:08.885235 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 418/863] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:08 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:54:09.081273 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-232f06f1-76d2-420a-aa9f-d7da480af9c9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:09.093135 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-232f06f1-76d2-420a-aa9f-d7da480af9c9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.384291 Jul 18 10:54:09.094030 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 446/864] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:08 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:09.925881 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a0412caa-2906-4c6a-9a3e-49d074b32e16 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:09.926671 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a0412caa-2906-4c6a-9a3e-49d074b32e16 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:09.933210 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a0412caa-2906-4c6a-9a3e-49d074b32e16 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:09.933660 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a0412caa-2906-4c6a-9a3e-49d074b32e16 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:09.934440 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a0412caa-2906-4c6a-9a3e-49d074b32e16 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:09.934880 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a0412caa-2906-4c6a-9a3e-49d074b32e16 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:10.102816 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a0412caa-2906-4c6a-9a3e-49d074b32e16 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:10.111209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a0412caa-2906-4c6a-9a3e-49d074b32e16 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:10.111958 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d7c8ccc9-2496-4ffa-94c8-b17158e2a654 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:10.112938 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d7c8ccc9-2496-4ffa-94c8-b17158e2a654 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:10.113052 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a0412caa-2906-4c6a-9a3e-49d074b32e16 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:10.115042 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a0412caa-2906-4c6a-9a3e-49d074b32e16 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.192981 Jul 18 10:54:10.115931 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 419/865] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:09 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:54:10.121362 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d7c8ccc9-2496-4ffa-94c8-b17158e2a654 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:10.121883 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d7c8ccc9-2496-4ffa-94c8-b17158e2a654 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:10.122606 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d7c8ccc9-2496-4ffa-94c8-b17158e2a654 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:10.123039 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d7c8ccc9-2496-4ffa-94c8-b17158e2a654 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:10.299793 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d7c8ccc9-2496-4ffa-94c8-b17158e2a654 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:10.321902 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d7c8ccc9-2496-4ffa-94c8-b17158e2a654 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.213489 Jul 18 10:54:10.323350 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 447/866] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:10 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:54:11.136848 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f762c29f-b777-46e2-ad37-d94d89e222b8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:11.137487 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f762c29f-b777-46e2-ad37-d94d89e222b8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:11.144363 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f762c29f-b777-46e2-ad37-d94d89e222b8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:11.145411 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f762c29f-b777-46e2-ad37-d94d89e222b8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:11.146910 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f762c29f-b777-46e2-ad37-d94d89e222b8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:11.147344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f762c29f-b777-46e2-ad37-d94d89e222b8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:11.286480 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f762c29f-b777-46e2-ad37-d94d89e222b8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:11.294660 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f762c29f-b777-46e2-ad37-d94d89e222b8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:11.296147 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f762c29f-b777-46e2-ad37-d94d89e222b8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:11.297353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f762c29f-b777-46e2-ad37-d94d89e222b8 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.164582 Jul 18 10:54:11.297905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 420/867] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:11 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:54:11.342766 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3494c746-0008-4cf5-af3e-68948c77cebf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:11.343412 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3494c746-0008-4cf5-af3e-68948c77cebf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:11.350220 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3494c746-0008-4cf5-af3e-68948c77cebf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:11.350676 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3494c746-0008-4cf5-af3e-68948c77cebf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:11.351638 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3494c746-0008-4cf5-af3e-68948c77cebf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:11.351872 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3494c746-0008-4cf5-af3e-68948c77cebf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:11.503774 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3494c746-0008-4cf5-af3e-68948c77cebf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:11.511133 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3494c746-0008-4cf5-af3e-68948c77cebf tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.172631 Jul 18 10:54:11.511721 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 448/868] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:11 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:12.315975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9779d6b8-b89d-4232-bf8c-ad007227e2d7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:12.317659 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-9779d6b8-b89d-4232-bf8c-ad007227e2d7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:12.323772 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9779d6b8-b89d-4232-bf8c-ad007227e2d7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:12.324268 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9779d6b8-b89d-4232-bf8c-ad007227e2d7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:12.325070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9779d6b8-b89d-4232-bf8c-ad007227e2d7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:12.325581 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9779d6b8-b89d-4232-bf8c-ad007227e2d7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:12.470468 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9779d6b8-b89d-4232-bf8c-ad007227e2d7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:12.479787 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9779d6b8-b89d-4232-bf8c-ad007227e2d7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:12.481483 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9779d6b8-b89d-4232-bf8c-ad007227e2d7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:12.482661 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9779d6b8-b89d-4232-bf8c-ad007227e2d7 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.170781 Jul 18 10:54:12.483205 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 421/869] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:12 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:54:12.530247 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-dbcfb4d1-ef58-4ab8-8afc-c9da9a31e6a7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:12.530942 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-dbcfb4d1-ef58-4ab8-8afc-c9da9a31e6a7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:12.539776 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dbcfb4d1-ef58-4ab8-8afc-c9da9a31e6a7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:12.540229 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dbcfb4d1-ef58-4ab8-8afc-c9da9a31e6a7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:12.541115 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dbcfb4d1-ef58-4ab8-8afc-c9da9a31e6a7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:12.541539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dbcfb4d1-ef58-4ab8-8afc-c9da9a31e6a7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:12.693994 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-dbcfb4d1-ef58-4ab8-8afc-c9da9a31e6a7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:12.701938 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-dbcfb4d1-ef58-4ab8-8afc-c9da9a31e6a7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1575 microversion: 2.1 time: 0.175570 Jul 18 10:54:12.702510 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 449/870] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:12 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:13.501488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a139be19-c129-44eb-8c94-7e87b926f33f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:13.502217 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a139be19-c129-44eb-8c94-7e87b926f33f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:13.510337 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a139be19-c129-44eb-8c94-7e87b926f33f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:13.510785 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a139be19-c129-44eb-8c94-7e87b926f33f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:13.511562 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a139be19-c129-44eb-8c94-7e87b926f33f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:13.512000 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a139be19-c129-44eb-8c94-7e87b926f33f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:13.675176 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a139be19-c129-44eb-8c94-7e87b926f33f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:13.678145 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a139be19-c129-44eb-8c94-7e87b926f33f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:13.679649 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a139be19-c129-44eb-8c94-7e87b926f33f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:13.680839 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a139be19-c129-44eb-8c94-7e87b926f33f tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.183333 Jul 18 10:54:13.681413 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 422/871] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:13 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:54:13.720596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a0ccd3cf-8f54-4f7c-b598-43263d0178cb tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:13.721255 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a0ccd3cf-8f54-4f7c-b598-43263d0178cb tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:13.738027 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0ccd3cf-8f54-4f7c-b598-43263d0178cb tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:13.738027 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0ccd3cf-8f54-4f7c-b598-43263d0178cb tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:13.738027 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0ccd3cf-8f54-4f7c-b598-43263d0178cb tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:13.738027 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0ccd3cf-8f54-4f7c-b598-43263d0178cb tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:13.883656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a0ccd3cf-8f54-4f7c-b598-43263d0178cb tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:13.885899 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=100 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:13.891966 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a0ccd3cf-8f54-4f7c-b598-43263d0178cb tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1562 microversion: 2.1 time: 0.175753 Jul 18 10:54:13.892647 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 450/872] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:13 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1562 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:54:14.699721 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-982b32f1-498b-41b4-9ffb-747eea6fd6fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:14.700339 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-982b32f1-498b-41b4-9ffb-747eea6fd6fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:14.708547 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-982b32f1-498b-41b4-9ffb-747eea6fd6fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:14.709022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-982b32f1-498b-41b4-9ffb-747eea6fd6fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:14.709813 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-982b32f1-498b-41b4-9ffb-747eea6fd6fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:14.710251 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-982b32f1-498b-41b4-9ffb-747eea6fd6fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:14.858918 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-982b32f1-498b-41b4-9ffb-747eea6fd6fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:14.862494 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:14.869352 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-982b32f1-498b-41b4-9ffb-747eea6fd6fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:14.870970 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-982b32f1-498b-41b4-9ffb-747eea6fd6fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:14.872146 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-982b32f1-498b-41b4-9ffb-747eea6fd6fa tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.176581 Jul 18 10:54:14.872706 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 423/873] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:14 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:54:15.009862 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-36c5f72b-382d-4e92-a602-f53c7bfaab0c req-304aac68-b6fd-427a-bd59-9aa01a471f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1b361f-a048-4231-8c87-b3b27c478f7d", "name": "network-vif-plugged", "status": "completed", "tag": "e168237a-b0b4-42cb-8c89-d5ade5d9cf57"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:54:15.019702 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-36c5f72b-382d-4e92-a602-f53c7bfaab0c req-304aac68-b6fd-427a-bd59-9aa01a471f57 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:15.020378 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-36c5f72b-382d-4e92-a602-f53c7bfaab0c req-304aac68-b6fd-427a-bd59-9aa01a471f57 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:15.033376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-36c5f72b-382d-4e92-a602-f53c7bfaab0c req-304aac68-b6fd-427a-bd59-9aa01a471f57 service nova] Creating event network-vif-plugged:e168237a-b0b4-42cb-8c89-d5ade5d9cf57 for instance 4f1b361f-a048-4231-8c87-b3b27c478f7d on hv-cinder-84949 Jul 18 10:54:15.039638 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-36c5f72b-382d-4e92-a602-f53c7bfaab0c req-304aac68-b6fd-427a-bd59-9aa01a471f57 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033457 Jul 18 10:54:15.040283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 451/874] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:15.891383 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-85e359d9-1fd7-429c-bf58-dd27dc587b9a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:15.892635 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-85e359d9-1fd7-429c-bf58-dd27dc587b9a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:15.900415 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-85e359d9-1fd7-429c-bf58-dd27dc587b9a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:15.900970 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-85e359d9-1fd7-429c-bf58-dd27dc587b9a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:15.901751 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-85e359d9-1fd7-429c-bf58-dd27dc587b9a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:15.902210 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-85e359d9-1fd7-429c-bf58-dd27dc587b9a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:16.052675 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-85e359d9-1fd7-429c-bf58-dd27dc587b9a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:16.061290 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-85e359d9-1fd7-429c-bf58-dd27dc587b9a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:16.062775 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-85e359d9-1fd7-429c-bf58-dd27dc587b9a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:16.064098 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-85e359d9-1fd7-429c-bf58-dd27dc587b9a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.177136 Jul 18 10:54:16.065045 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 424/875] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:15 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:54:17.086176 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ba8adc8c-5a2a-40d9-8076-7a19625ff690 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:17.087081 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ba8adc8c-5a2a-40d9-8076-7a19625ff690 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:17.095076 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ba8adc8c-5a2a-40d9-8076-7a19625ff690 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:17.095610 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ba8adc8c-5a2a-40d9-8076-7a19625ff690 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:17.096615 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ba8adc8c-5a2a-40d9-8076-7a19625ff690 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:17.097344 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ba8adc8c-5a2a-40d9-8076-7a19625ff690 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:17.236914 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ba8adc8c-5a2a-40d9-8076-7a19625ff690 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:17.246697 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ba8adc8c-5a2a-40d9-8076-7a19625ff690 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:17.248666 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ba8adc8c-5a2a-40d9-8076-7a19625ff690 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:17.249934 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ba8adc8c-5a2a-40d9-8076-7a19625ff690 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.169429 Jul 18 10:54:17.250900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 452/876] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:17 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:54:18.270145 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-0b7996a9-a63b-4329-b047-91adba62e0d3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:18.271468 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-0b7996a9-a63b-4329-b047-91adba62e0d3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:18.278189 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b7996a9-a63b-4329-b047-91adba62e0d3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:18.278627 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b7996a9-a63b-4329-b047-91adba62e0d3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:18.279379 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b7996a9-a63b-4329-b047-91adba62e0d3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:18.279907 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0b7996a9-a63b-4329-b047-91adba62e0d3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:18.425185 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0b7996a9-a63b-4329-b047-91adba62e0d3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:18.434501 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0b7996a9-a63b-4329-b047-91adba62e0d3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:18.436032 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0b7996a9-a63b-4329-b047-91adba62e0d3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:18.437259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-0b7996a9-a63b-4329-b047-91adba62e0d3 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1729 microversion: 2.20 time: 0.172259 Jul 18 10:54:18.437820 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 425/877] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:18 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:54:19.450302 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b32c48e2-0804-485c-bcaf-ba3d9257c803 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:19.455104 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-b32c48e2-0804-485c-bcaf-ba3d9257c803 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:19.455531 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-86beb9b7-676c-4aed-8966-d98d494add38 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:19.456147 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-86beb9b7-676c-4aed-8966-d98d494add38 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:19.457963 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b32c48e2-0804-485c-bcaf-ba3d9257c803 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:19.458414 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b32c48e2-0804-485c-bcaf-ba3d9257c803 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:19.459188 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b32c48e2-0804-485c-bcaf-ba3d9257c803 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:19.459677 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-b32c48e2-0804-485c-bcaf-ba3d9257c803 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:19.463298 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-86beb9b7-676c-4aed-8966-d98d494add38 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:19.463822 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-86beb9b7-676c-4aed-8966-d98d494add38 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:19.464983 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-86beb9b7-676c-4aed-8966-d98d494add38 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:19.465487 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-86beb9b7-676c-4aed-8966-d98d494add38 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:19.544221 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-b32c48e2-0804-485c-bcaf-ba3d9257c803 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lazy-loading 'services' on Instance uuid 9faaf917-748f-4856-8100-c52e60ae0543 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:54:19.609586 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-86beb9b7-676c-4aed-8966-d98d494add38 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:19.619163 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-86beb9b7-676c-4aed-8966-d98d494add38 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:19.620647 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-86beb9b7-676c-4aed-8966-d98d494add38 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:19.621825 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-86beb9b7-676c-4aed-8966-d98d494add38 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1716 microversion: 2.20 time: 0.170411 Jul 18 10:54:19.623010 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 426/878] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:54:19 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:54:19.790898 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b32c48e2-0804-485c-bcaf-ba3d9257c803 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543/os-volume_attachments/bcaa7f10-3661-4f0c-a7f7-c1659ead80ca" status: 202 len: 0 microversion: 2.1 time: 0.344534 Jul 18 10:54:19.791533 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 453/879] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 18 10:54:19 2022] DELETE /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543/os-volume_attachments/bcaa7f10-3661-4f0c-a7f7-c1659ead80ca => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:54:19.800453 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-534737f3-4abf-42ac-840d-fde227076786 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:19.801638 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-534737f3-4abf-42ac-840d-fde227076786 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:19.810008 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-534737f3-4abf-42ac-840d-fde227076786 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:19.810453 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-534737f3-4abf-42ac-840d-fde227076786 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:19.811261 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-534737f3-4abf-42ac-840d-fde227076786 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:19.811701 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-534737f3-4abf-42ac-840d-fde227076786 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:19.844334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-534737f3-4abf-42ac-840d-fde227076786 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048243 Jul 18 10:54:19.848573 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 427/880] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:54:19 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:20.861276 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f504e052-b8e7-47b6-805e-1b6b9d313b8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:20.862754 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f504e052-b8e7-47b6-805e-1b6b9d313b8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:20.870907 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f504e052-b8e7-47b6-805e-1b6b9d313b8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:20.871356 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f504e052-b8e7-47b6-805e-1b6b9d313b8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:20.872132 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f504e052-b8e7-47b6-805e-1b6b9d313b8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:20.872651 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f504e052-b8e7-47b6-805e-1b6b9d313b8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:20.903041 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f504e052-b8e7-47b6-805e-1b6b9d313b8b tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049438 Jul 18 10:54:20.903041 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 454/881] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:54:20 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:54:20.967950 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-890bb272-7a6b-461b-b9ba-dc4113bd2aa4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:20.968526 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-890bb272-7a6b-461b-b9ba-dc4113bd2aa4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:20.975643 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-890bb272-7a6b-461b-b9ba-dc4113bd2aa4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:20.976080 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-890bb272-7a6b-461b-b9ba-dc4113bd2aa4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:20.977575 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-890bb272-7a6b-461b-b9ba-dc4113bd2aa4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:20.977575 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-890bb272-7a6b-461b-b9ba-dc4113bd2aa4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:21.007931 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-890bb272-7a6b-461b-b9ba-dc4113bd2aa4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Going to try to terminate instance {{(pid=125005) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:54:21.367954 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-890bb272-7a6b-461b-b9ba-dc4113bd2aa4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 204 len: 0 microversion: 2.1 time: 0.403799 Jul 18 10:54:21.368587 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 428/882] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:54:20 2022] DELETE /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:54:21.377070 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-c6322224-adf3-41d7-906b-85dd6c919964 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:21.377682 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-c6322224-adf3-41d7-906b-85dd6c919964 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:21.384064 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c6322224-adf3-41d7-906b-85dd6c919964 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:21.384508 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c6322224-adf3-41d7-906b-85dd6c919964 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:21.385307 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c6322224-adf3-41d7-906b-85dd6c919964 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:21.385748 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-c6322224-adf3-41d7-906b-85dd6c919964 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:21.530533 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-c6322224-adf3-41d7-906b-85dd6c919964 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:21.538946 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-c6322224-adf3-41d7-906b-85dd6c919964 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1680 microversion: 2.1 time: 0.165900 Jul 18 10:54:21.539521 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 455/883] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:21 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:22.556534 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c9475281-8929-409c-bff7-4625fc4f484c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:22.557446 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c9475281-8929-409c-bff7-4625fc4f484c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:22.564145 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c9475281-8929-409c-bff7-4625fc4f484c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:22.564664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c9475281-8929-409c-bff7-4625fc4f484c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:22.565514 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c9475281-8929-409c-bff7-4625fc4f484c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:22.565936 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c9475281-8929-409c-bff7-4625fc4f484c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:22.711949 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c9475281-8929-409c-bff7-4625fc4f484c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:22.720514 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c9475281-8929-409c-bff7-4625fc4f484c tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1680 microversion: 2.1 time: 0.168432 Jul 18 10:54:22.721174 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 429/884] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:22 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:23.739046 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6471ce78-f8e0-49da-93a0-018b02464c37 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:23.739682 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6471ce78-f8e0-49da-93a0-018b02464c37 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:23.747421 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6471ce78-f8e0-49da-93a0-018b02464c37 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:23.747908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6471ce78-f8e0-49da-93a0-018b02464c37 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:23.748817 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6471ce78-f8e0-49da-93a0-018b02464c37 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:23.749303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6471ce78-f8e0-49da-93a0-018b02464c37 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:23.926323 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-6471ce78-f8e0-49da-93a0-018b02464c37 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:23.938842 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6471ce78-f8e0-49da-93a0-018b02464c37 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1680 microversion: 2.1 time: 0.201525 Jul 18 10:54:23.938842 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 456/885] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:23 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:24.371214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-8efae5ad-9c63-4a3c-abc4-7f0d507189bd req-c4bf2fb5-1410-4818-a2e2-4c325a4e37c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9faaf917-748f-4856-8100-c52e60ae0543", "name": "network-vif-deleted", "tag": "c81718ab-c440-4c7c-acd6-9b66da2b719c"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:54:24.382208 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-8efae5ad-9c63-4a3c-abc4-7f0d507189bd req-c4bf2fb5-1410-4818-a2e2-4c325a4e37c9 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:24.382645 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-8efae5ad-9c63-4a3c-abc4-7f0d507189bd req-c4bf2fb5-1410-4818-a2e2-4c325a4e37c9 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:24.395602 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-8efae5ad-9c63-4a3c-abc4-7f0d507189bd req-c4bf2fb5-1410-4818-a2e2-4c325a4e37c9 service nova] Creating event network-vif-deleted:c81718ab-c440-4c7c-acd6-9b66da2b719c for instance 9faaf917-748f-4856-8100-c52e60ae0543 on hv-cinder-84949 Jul 18 10:54:24.400572 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-8efae5ad-9c63-4a3c-abc4-7f0d507189bd req-c4bf2fb5-1410-4818-a2e2-4c325a4e37c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033507 Jul 18 10:54:24.401437 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 430/886] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:24.955380 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-95a04a95-ba80-47a1-89a8-ba879e67424a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:24.956506 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-95a04a95-ba80-47a1-89a8-ba879e67424a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:24.964797 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-95a04a95-ba80-47a1-89a8-ba879e67424a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:24.965346 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-95a04a95-ba80-47a1-89a8-ba879e67424a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:24.966247 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-95a04a95-ba80-47a1-89a8-ba879e67424a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:24.966972 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-95a04a95-ba80-47a1-89a8-ba879e67424a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:25.015347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-95a04a95-ba80-47a1-89a8-ba879e67424a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:25.015887 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-95a04a95-ba80-47a1-89a8-ba879e67424a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:25.016472 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-95a04a95-ba80-47a1-89a8-ba879e67424a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lazy-loading 'fault' on Instance uuid 9faaf917-748f-4856-8100-c52e60ae0543 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:54:25.063480 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-95a04a95-ba80-47a1-89a8-ba879e67424a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:25.072926 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-95a04a95-ba80-47a1-89a8-ba879e67424a tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1331 microversion: 2.1 time: 0.121798 Jul 18 10:54:25.073509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 457/887] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:24 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1331 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:26.091496 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-00a51bca-aef7-4a49-b0a4-45ef9d95cf7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:26.092188 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-00a51bca-aef7-4a49-b0a4-45ef9d95cf7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:26.100124 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-00a51bca-aef7-4a49-b0a4-45ef9d95cf7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:26.100569 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-00a51bca-aef7-4a49-b0a4-45ef9d95cf7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:26.101480 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-00a51bca-aef7-4a49-b0a4-45ef9d95cf7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:26.101926 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-00a51bca-aef7-4a49-b0a4-45ef9d95cf7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:26.137718 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-00a51bca-aef7-4a49-b0a4-45ef9d95cf7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:26.138185 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-00a51bca-aef7-4a49-b0a4-45ef9d95cf7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:26.138623 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-00a51bca-aef7-4a49-b0a4-45ef9d95cf7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lazy-loading 'fault' on Instance uuid 9faaf917-748f-4856-8100-c52e60ae0543 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:54:26.183834 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-00a51bca-aef7-4a49-b0a4-45ef9d95cf7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:26.193617 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-00a51bca-aef7-4a49-b0a4-45ef9d95cf7e tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1331 microversion: 2.1 time: 0.106659 Jul 18 10:54:26.194314 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 431/888] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:26 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:27.211336 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d4062d1f-a0ff-4106-b3bb-20c2655de601 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:27.211943 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d4062d1f-a0ff-4106-b3bb-20c2655de601 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:27.218745 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d4062d1f-a0ff-4106-b3bb-20c2655de601 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:27.219192 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d4062d1f-a0ff-4106-b3bb-20c2655de601 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:27.219952 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d4062d1f-a0ff-4106-b3bb-20c2655de601 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:27.220389 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d4062d1f-a0ff-4106-b3bb-20c2655de601 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:27.252300 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d4062d1f-a0ff-4106-b3bb-20c2655de601 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:27.252745 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d4062d1f-a0ff-4106-b3bb-20c2655de601 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:27.253223 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-d4062d1f-a0ff-4106-b3bb-20c2655de601 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lazy-loading 'fault' on Instance uuid 9faaf917-748f-4856-8100-c52e60ae0543 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:54:27.294256 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d4062d1f-a0ff-4106-b3bb-20c2655de601 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:27.301765 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d4062d1f-a0ff-4106-b3bb-20c2655de601 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1331 microversion: 2.1 time: 0.094946 Jul 18 10:54:27.302331 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 458/889] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:27 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:28.319192 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-89b8bc2b-33f2-4cf4-be33-cd30fda0e169 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:28.319991 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-89b8bc2b-33f2-4cf4-be33-cd30fda0e169 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:28.326756 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89b8bc2b-33f2-4cf4-be33-cd30fda0e169 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:28.337861 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89b8bc2b-33f2-4cf4-be33-cd30fda0e169 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:28.337861 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89b8bc2b-33f2-4cf4-be33-cd30fda0e169 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:28.337861 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89b8bc2b-33f2-4cf4-be33-cd30fda0e169 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:28.360695 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89b8bc2b-33f2-4cf4-be33-cd30fda0e169 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:28.361171 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89b8bc2b-33f2-4cf4-be33-cd30fda0e169 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:28.361615 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-89b8bc2b-33f2-4cf4-be33-cd30fda0e169 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lazy-loading 'fault' on Instance uuid 9faaf917-748f-4856-8100-c52e60ae0543 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:54:28.404272 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-89b8bc2b-33f2-4cf4-be33-cd30fda0e169 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3954fd4abf6b4c3a82280c762292a3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04716d82e1084ec58b2a4909710a6ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:54:28.413343 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-89b8bc2b-33f2-4cf4-be33-cd30fda0e169 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 200 len: 1331 microversion: 2.1 time: 0.098632 Jul 18 10:54:28.413952 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 432/890] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:28 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:29.431855 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5188972f-87d0-4111-9bdf-1ddd2cd673da tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:29.432401 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-5188972f-87d0-4111-9bdf-1ddd2cd673da tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:29.438900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5188972f-87d0-4111-9bdf-1ddd2cd673da tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:29.439342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5188972f-87d0-4111-9bdf-1ddd2cd673da tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:29.440142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5188972f-87d0-4111-9bdf-1ddd2cd673da tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:29.440576 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5188972f-87d0-4111-9bdf-1ddd2cd673da tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:29.454010 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-5188972f-87d0-4111-9bdf-1ddd2cd673da tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] HTTP exception thrown: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5188972f-87d0-4111-9bdf-1ddd2cd673da tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Request method failure captured: Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 HTTP/1.1 Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To3grVh5eba67sMHj3Z1DSA3fIUC9f5wIxOuVBPUD51Z7C3u9-HXpsXd8cB6k0mN-6p1y9OtAmiFcgdD3J1fX4g3yITPuNgpxLVfMocjGOIBC9EjXhO_0oCAHoqkj4rFWVIlBvaa2J_jvIj5l1Y1IoF1YPGIt2tFFq5BZ3pTrErcdc Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:54:29.455656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:54:29.458303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:54:29.458303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:29.458303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:29.458303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:29.458303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:29.458303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:54:29.458303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:54:29.458303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 3954fd4abf6b4c3a82280c762292a3e7 Jul 18 10:54:29.458303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:29.458303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:54:29.458303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. Jul 18 10:54:29.458303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '9faaf917-748f-4856-8100-c52e60ae0543'} Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:54:29.459260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. Jul 18 10:54:29.460814 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:29.462250 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5188972f-87d0-4111-9bdf-1ddd2cd673da tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Returning 404 to user: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:54:29.462250 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5188972f-87d0-4111-9bdf-1ddd2cd673da tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 404 len: 111 microversion: 2.1 time: 0.029884 Jul 18 10:54:29.462250 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 459/891] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:29 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:54:29.466946 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-42aee8e0-8d8e-46c2-8669-a63b1d2aeb1f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '.version_select at 0x7f6364c29c10>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:29.473676 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:29.563554 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-42aee8e0-8d8e-46c2-8669-a63b1d2aeb1f tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1524473695" status: 202 len: 0 microversion: 2.1 time: 0.100610 Jul 18 10:54:29.564332 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 433/892] 10.222.0.49 () {58 vars in 1220 bytes} [Mon Jul 18 10:54:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1524473695 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 10:54:32.747207 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a4f88803-608d-40e5-aa28-92f78f88d685 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:32.747793 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a4f88803-608d-40e5-aa28-92f78f88d685 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:32.762191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a4f88803-608d-40e5-aa28-92f78f88d685 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:32.762191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a4f88803-608d-40e5-aa28-92f78f88d685 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:32.762191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a4f88803-608d-40e5-aa28-92f78f88d685 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:32.762191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a4f88803-608d-40e5-aa28-92f78f88d685 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:32.771255 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-a4f88803-608d-40e5-aa28-92f78f88d685 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] HTTP exception thrown: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a4f88803-608d-40e5-aa28-92f78f88d685 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Request method failure captured: Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: DELETE /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 HTTP/1.1 Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To3grVh5eba67sMHj3Z1DSA3fIUC9f5wIxOuVBPUD51Z7C3u9-HXpsXd8cB6k0mN-6p1y9OtAmiFcgdD3J1fX4g3yITPuNgpxLVfMocjGOIBC9EjXhO_0oCAHoqkj4rFWVIlBvaa2J_jvIj5l1Y1IoF1YPGIt2tFFq5BZ3pTrErcdc Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:54:32.772950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:54:32.774471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:54:32.774471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:32.774471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:32.774471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:32.774471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:32.774471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:54:32.774471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:54:32.774471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 3954fd4abf6b4c3a82280c762292a3e7 Jul 18 10:54:32.774471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:32.774471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:54:32.774471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. Jul 18 10:54:32.774471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '9faaf917-748f-4856-8100-c52e60ae0543'} Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:54:32.778625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. Jul 18 10:54:32.780253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:32.781697 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a4f88803-608d-40e5-aa28-92f78f88d685 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Returning 404 to user: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:54:32.781697 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a4f88803-608d-40e5-aa28-92f78f88d685 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 404 len: 111 microversion: 2.1 time: 0.031017 Jul 18 10:54:32.781697 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 460/893] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:54:32 2022] DELETE /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:54:32.783672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f846c4af-d4ed-4151-aa24-603d2898d565 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:32.784337 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f846c4af-d4ed-4151-aa24-603d2898d565 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 9faaf917-748f-4856-8100-c52e60ae0543] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:32.791274 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f846c4af-d4ed-4151-aa24-603d2898d565 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:32.791720 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f846c4af-d4ed-4151-aa24-603d2898d565 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:32.792492 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f846c4af-d4ed-4151-aa24-603d2898d565 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:32.792973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f846c4af-d4ed-4151-aa24-603d2898d565 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:32.808639 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-f846c4af-d4ed-4151-aa24-603d2898d565 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] HTTP exception thrown: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f846c4af-d4ed-4151-aa24-603d2898d565 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Request method failure captured: Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 HTTP/1.1 Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1To3grVh5eba67sMHj3Z1DSA3fIUC9f5wIxOuVBPUD51Z7C3u9-HXpsXd8cB6k0mN-6p1y9OtAmiFcgdD3J1fX4g3yITPuNgpxLVfMocjGOIBC9EjXhO_0oCAHoqkj4rFWVIlBvaa2J_jvIj5l1Y1IoF1YPGIt2tFFq5BZ3pTrErcdc Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:54:32.810334 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:54:32.811980 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:54:32.811980 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:32.811980 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:32.811980 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:32.811980 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:32.811980 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:54:32.811980 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:54:32.811980 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 3954fd4abf6b4c3a82280c762292a3e7 Jul 18 10:54:32.811980 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:32.811980 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:54:32.811980 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. Jul 18 10:54:32.811980 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '9faaf917-748f-4856-8100-c52e60ae0543'} Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:54:32.813024 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. Jul 18 10:54:32.814404 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:32.817317 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f846c4af-d4ed-4151-aa24-603d2898d565 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Returning 404 to user: Instance 9faaf917-748f-4856-8100-c52e60ae0543 could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:54:32.817317 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f846c4af-d4ed-4151-aa24-603d2898d565 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543" status: 404 len: 111 microversion: 2.1 time: 0.032510 Jul 18 10:54:32.817317 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 434/894] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:32 2022] GET /compute/v2.1/servers/9faaf917-748f-4856-8100-c52e60ae0543 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:54:34.222578 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0b7d65b1-f459-491c-a133-9daed9e04abb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:34.223451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-0b7d65b1-f459-491c-a133-9daed9e04abb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:34.229884 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0b7d65b1-f459-491c-a133-9daed9e04abb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:34.230334 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0b7d65b1-f459-491c-a133-9daed9e04abb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:34.241861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0b7d65b1-f459-491c-a133-9daed9e04abb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:34.241861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0b7d65b1-f459-491c-a133-9daed9e04abb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:34.245595 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-0b7d65b1-f459-491c-a133-9daed9e04abb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] HTTP exception thrown: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0b7d65b1-f459-491c-a133-9daed9e04abb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Request method failure captured: Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: DELETE /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 HTTP/1.1 Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To3grVh5eba67sMHj3Z1DSA3fIUC9f5wIxOuVBPUD51Z7C3u9-HXpsXd8cB6k0mN-6p1y9OtAmiFcgdD3J1fX4g3yITPuNgpxLVfMocjGOIBC9EjXhO_0oCAHoqkj4rFWVIlBvaa2J_jvIj5l1Y1IoF1YPGIt2tFFq5BZ3pTrErcdc Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:54:34.247156 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:54:34.248684 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:54:34.248684 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:34.248684 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:34.248684 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:34.248684 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:34.248684 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:54:34.248684 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:54:34.248684 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 3954fd4abf6b4c3a82280c762292a3e7 Jul 18 10:54:34.248684 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:34.248684 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:54:34.248684 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. Jul 18 10:54:34.248684 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924'} Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:54:34.249509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. Jul 18 10:54:34.250717 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.251904 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0b7d65b1-f459-491c-a133-9daed9e04abb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Returning 404 to user: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:54:34.251904 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-0b7d65b1-f459-491c-a133-9daed9e04abb tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 404 len: 111 microversion: 2.1 time: 0.030615 Jul 18 10:54:34.251904 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 461/895] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:54:34 2022] DELETE /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:54:34.257630 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d817f379-b13c-4508-a453-a1540eddbadc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:34.258247 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d817f379-b13c-4508-a453-a1540eddbadc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:34.264758 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d817f379-b13c-4508-a453-a1540eddbadc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:34.265245 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d817f379-b13c-4508-a453-a1540eddbadc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:34.266001 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d817f379-b13c-4508-a453-a1540eddbadc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:34.266431 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d817f379-b13c-4508-a453-a1540eddbadc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:34.280761 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-d817f379-b13c-4508-a453-a1540eddbadc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] HTTP exception thrown: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d817f379-b13c-4508-a453-a1540eddbadc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Request method failure captured: Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 HTTP/1.1 Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1To3grVh5eba67sMHj3Z1DSA3fIUC9f5wIxOuVBPUD51Z7C3u9-HXpsXd8cB6k0mN-6p1y9OtAmiFcgdD3J1fX4g3yITPuNgpxLVfMocjGOIBC9EjXhO_0oCAHoqkj4rFWVIlBvaa2J_jvIj5l1Y1IoF1YPGIt2tFFq5BZ3pTrErcdc Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:54:34.282295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:54:34.283835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:54:34.283835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:34.283835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:34.283835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:34.283835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:34.283835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:54:34.283835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:54:34.283835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 3954fd4abf6b4c3a82280c762292a3e7 Jul 18 10:54:34.283835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:34.283835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:54:34.283835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. Jul 18 10:54:34.283835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924'} Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:54:34.285259 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. Jul 18 10:54:34.286828 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.288132 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d817f379-b13c-4508-a453-a1540eddbadc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Returning 404 to user: Instance 8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:54:34.288132 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d817f379-b13c-4508-a453-a1540eddbadc tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924" status: 404 len: 111 microversion: 2.1 time: 0.030098 Jul 18 10:54:34.288132 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 435/896] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:34 2022] GET /compute/v2.1/servers/8ed7bef2-5b0f-4c62-b880-ab7c4d1fa924 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:54:34.294125 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6bec1206-e17e-4f73-b9d5-f31e3c03f860 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:34.294621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6bec1206-e17e-4f73-b9d5-f31e3c03f860 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:34.301103 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6bec1206-e17e-4f73-b9d5-f31e3c03f860 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:34.301552 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6bec1206-e17e-4f73-b9d5-f31e3c03f860 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:34.302556 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6bec1206-e17e-4f73-b9d5-f31e3c03f860 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:34.302816 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6bec1206-e17e-4f73-b9d5-f31e3c03f860 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-6bec1206-e17e-4f73-b9d5-f31e3c03f860 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] HTTP exception thrown: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6bec1206-e17e-4f73-b9d5-f31e3c03f860 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Request method failure captured: Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: DELETE /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 HTTP/1.1 Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To3grVh5eba67sMHj3Z1DSA3fIUC9f5wIxOuVBPUD51Z7C3u9-HXpsXd8cB6k0mN-6p1y9OtAmiFcgdD3J1fX4g3yITPuNgpxLVfMocjGOIBC9EjXhO_0oCAHoqkj4rFWVIlBvaa2J_jvIj5l1Y1IoF1YPGIt2tFFq5BZ3pTrErcdc Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:54:34.323849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:54:34.325740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:54:34.325740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:34.325740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:34.325740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:34.325740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:34.325740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:54:34.325740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:54:34.325740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 3954fd4abf6b4c3a82280c762292a3e7 Jul 18 10:54:34.325740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:34.325740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:54:34.325740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. Jul 18 10:54:34.325740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '31366990-97f1-495a-98b8-0ff44a44f7e1'} Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:54:34.326716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. Jul 18 10:54:34.328149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.329606 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6bec1206-e17e-4f73-b9d5-f31e3c03f860 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Returning 404 to user: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:54:34.329606 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6bec1206-e17e-4f73-b9d5-f31e3c03f860 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "DELETE /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 404 len: 111 microversion: 2.1 time: 0.032200 Jul 18 10:54:34.329606 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 462/897] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:54:34 2022] DELETE /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:54:34.332698 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c27fce50-e535-472b-ba59-d412e742dea9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:34.333348 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c27fce50-e535-472b-ba59-d412e742dea9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: 31366990-97f1-495a-98b8-0ff44a44f7e1] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:34.339943 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c27fce50-e535-472b-ba59-d412e742dea9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:34.340383 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c27fce50-e535-472b-ba59-d412e742dea9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:34.341308 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c27fce50-e535-472b-ba59-d412e742dea9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:34.341604 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c27fce50-e535-472b-ba59-d412e742dea9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:34.355773 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-c27fce50-e535-472b-ba59-d412e742dea9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] HTTP exception thrown: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c27fce50-e535-472b-ba59-d412e742dea9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Request method failure captured: Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 HTTP/1.1 Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1To3grVh5eba67sMHj3Z1DSA3fIUC9f5wIxOuVBPUD51Z7C3u9-HXpsXd8cB6k0mN-6p1y9OtAmiFcgdD3J1fX4g3yITPuNgpxLVfMocjGOIBC9EjXhO_0oCAHoqkj4rFWVIlBvaa2J_jvIj5l1Y1IoF1YPGIt2tFFq5BZ3pTrErcdc Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:54:34.357344 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:54:34.363491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:54:34.363491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:34.363491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:34.363491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:34.363491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:34.363491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:54:34.363491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:54:34.363491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 3954fd4abf6b4c3a82280c762292a3e7 Jul 18 10:54:34.363491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:34.363491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:54:34.363491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. Jul 18 10:54:34.363491 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '31366990-97f1-495a-98b8-0ff44a44f7e1'} Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:54:34.364754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. Jul 18 10:54:34.366277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:34.367788 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c27fce50-e535-472b-ba59-d412e742dea9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Returning 404 to user: Instance 31366990-97f1-495a-98b8-0ff44a44f7e1 could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:54:34.367788 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c27fce50-e535-472b-ba59-d412e742dea9 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1" status: 404 len: 111 microversion: 2.1 time: 0.031233 Jul 18 10:54:34.367788 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 436/898] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:34 2022] GET /compute/v2.1/servers/31366990-97f1-495a-98b8-0ff44a44f7e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:54:35.725960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-bca688be-1065-42b4-b296-6128971778df tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:35.728374 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-bca688be-1065-42b4-b296-6128971778df tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:35.733577 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bca688be-1065-42b4-b296-6128971778df tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:35.734027 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bca688be-1065-42b4-b296-6128971778df tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:35.734800 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bca688be-1065-42b4-b296-6128971778df tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:35.735300 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bca688be-1065-42b4-b296-6128971778df tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:35.749322 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-bca688be-1065-42b4-b296-6128971778df tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] HTTP exception thrown: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-bca688be-1065-42b4-b296-6128971778df tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Request method failure captured: Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: DELETE /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 HTTP/1.1 Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To3grVh5eba67sMHj3Z1DSA3fIUC9f5wIxOuVBPUD51Z7C3u9-HXpsXd8cB6k0mN-6p1y9OtAmiFcgdD3J1fX4g3yITPuNgpxLVfMocjGOIBC9EjXhO_0oCAHoqkj4rFWVIlBvaa2J_jvIj5l1Y1IoF1YPGIt2tFFq5BZ3pTrErcdc Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:54:35.750879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:54:35.752581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:54:35.752581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:35.752581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:35.752581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:35.752581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:35.752581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:54:35.752581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:54:35.752581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 3954fd4abf6b4c3a82280c762292a3e7 Jul 18 10:54:35.752581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:35.752581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:54:35.752581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. Jul 18 10:54:35.752581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': 'eadfa860-196c-4946-85a4-a9a2aed7c1b7'} Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:54:35.753727 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. Jul 18 10:54:35.755227 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:35.756667 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-bca688be-1065-42b4-b296-6128971778df tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Returning 404 to user: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:54:35.756667 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-bca688be-1065-42b4-b296-6128971778df tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "DELETE /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 404 len: 111 microversion: 2.1 time: 0.031017 Jul 18 10:54:35.756667 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 463/899] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:54:35 2022] DELETE /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:54:35.761081 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8ee30263-727b-425d-9830-471a3db88de4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:35.761685 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8ee30263-727b-425d-9830-471a3db88de4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] [instance: eadfa860-196c-4946-85a4-a9a2aed7c1b7] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:54:35.768515 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8ee30263-727b-425d-9830-471a3db88de4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:35.769979 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8ee30263-727b-425d-9830-471a3db88de4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:35.770800 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8ee30263-727b-425d-9830-471a3db88de4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:54:35.771231 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8ee30263-727b-425d-9830-471a3db88de4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:54:35.786152 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-8ee30263-727b-425d-9830-471a3db88de4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] HTTP exception thrown: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8ee30263-727b-425d-9830-471a3db88de4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Request method failure captured: Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 HTTP/1.1 Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1To3grVh5eba67sMHj3Z1DSA3fIUC9f5wIxOuVBPUD51Z7C3u9-HXpsXd8cB6k0mN-6p1y9OtAmiFcgdD3J1fX4g3yITPuNgpxLVfMocjGOIBC9EjXhO_0oCAHoqkj4rFWVIlBvaa2J_jvIj5l1Y1IoF1YPGIt2tFFq5BZ3pTrErcdc Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:54:35.787664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:54:35.789391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/04716d82e1084ec58b2a4909710a6ce8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:54:35.789391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:35.789391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 04716d82e1084ec58b2a4909710a6ce8 Jul 18 10:54:35.789391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-329165932 Jul 18 10:54:35.789391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:35.789391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:54:35.789391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:54:35.789391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 3954fd4abf6b4c3a82280c762292a3e7 Jul 18 10:54:35.789391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-AttachVolumeNegativeTest-329165932-project Jul 18 10:54:35.789391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:54:35.789391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. Jul 18 10:54:35.789391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': 'eadfa860-196c-4946-85a4-a9a2aed7c1b7'} Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:54:35.790512 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. Jul 18 10:54:35.791973 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:54:35.793381 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8ee30263-727b-425d-9830-471a3db88de4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] Returning 404 to user: Instance eadfa860-196c-4946-85a4-a9a2aed7c1b7 could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:54:35.793381 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8ee30263-727b-425d-9830-471a3db88de4 tempest-AttachVolumeNegativeTest-329165932 tempest-AttachVolumeNegativeTest-329165932-project] 10.222.0.49 "GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7" status: 404 len: 111 microversion: 2.1 time: 0.031872 Jul 18 10:54:35.793381 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 437/900] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:54:35 2022] GET /compute/v2.1/servers/eadfa860-196c-4946-85a4-a9a2aed7c1b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:54:42.323125 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5bdedda3-23fb-484b-8655-e3f79af63119 tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] Action: 'create', calling method: .version_select at 0x7f6364d0bf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1869664364", "metadata": {"Type": "work"}}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:54:43.282385 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5bdedda3-23fb-484b-8655-e3f79af63119 tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.085600 Jul 18 10:54:43.283044 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 464/901] 10.222.0.49 () {60 vars in 1155 bytes} [Mon Jul 18 10:54:42 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1087 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 10:54:43.293979 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-1a185f80-5eb3-441c-b666-40370fc0f99f tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] Calling method '.version_select at 0x7f6364b499d0>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:43.344677 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-1a185f80-5eb3-441c-b666-40370fc0f99f tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2" status: 200 len: 353 microversion: 2.1 time: 0.054430 Jul 18 10:54:43.345277 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 438/902] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:54:43 2022] GET /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:44.359220 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b01061ce-d8f9-4239-b0f9-2eccdbe0f931 tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] Calling method '.version_select at 0x7f6364c83f70>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:44.410582 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b01061ce-d8f9-4239-b0f9-2eccdbe0f931 tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2" status: 200 len: 353 microversion: 2.1 time: 0.055986 Jul 18 10:54:44.411163 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 465/903] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:54:44 2022] GET /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:45.423936 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9ec8f0c0-1d43-436c-b972-0d29aa555db0 tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] Calling method '.version_select at 0x7f6364b62a60>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:45.475070 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9ec8f0c0-1d43-436c-b972-0d29aa555db0 tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2" status: 200 len: 353 microversion: 2.1 time: 0.055573 Jul 18 10:54:45.475800 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 439/904] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:54:45 2022] GET /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:54:46.485019 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=43 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:46.485555 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:46.491633 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5cac0aea-195d-4a69-9411-c3c0721aa0cd tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] Calling method '.version_select at 0x7f6364c0a5e0>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:46.545676 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5cac0aea-195d-4a69-9411-c3c0721aa0cd tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2" status: 200 len: 354 microversion: 2.1 time: 0.062090 Jul 18 10:54:46.546241 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 466/905] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:54:46 2022] GET /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:46.555198 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:46.560724 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:46.560724 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-029d93d8-ed6a-4b14-907c-cd1fa7645e14 tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] Calling method '.version_select at 0x7f6364b37430>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:46.611673 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-029d93d8-ed6a-4b14-907c-cd1fa7645e14 tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2" status: 200 len: 354 microversion: 2.1 time: 0.057162 Jul 18 10:54:46.612477 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 440/906] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:54:46 2022] GET /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:46.624936 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a8622113-891a-4099-b153-c5b2b2db2fff tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] Calling method '.version_select at 0x7f6364d4a5e0>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:46.887990 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a8622113-891a-4099-b153-c5b2b2db2fff tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2" status: 202 len: 0 microversion: 2.1 time: 0.267498 Jul 18 10:54:46.888572 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 467/907] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 18 10:54:46 2022] DELETE /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:54:46.897922 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-fa85571e-4570-40a2-ad11-74f7e260d7aa tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] Calling method '.version_select at 0x7f6364b73af0>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:46.949899 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-fa85571e-4570-40a2-ad11-74f7e260d7aa tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2" status: 200 len: 353 microversion: 2.1 time: 0.057084 Jul 18 10:54:46.950475 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 441/908] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:54:46 2022] GET /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:47.964210 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6188821a-7024-4521-a571-2845bf92ea0e tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] Calling method '.version_select at 0x7f6364af3a60>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:47.995817 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-6188821a-7024-4521-a571-2845bf92ea0e tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] HTTP exception thrown: Volume cf67bb53-7802-4845-9a22-19221edd4ff2 could not be found. Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6188821a-7024-4521-a571-2845bf92ea0e tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] Request method failure captured: Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2 HTTP/1.1 Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1TvyMXX4KrZNQ4IAv7ce7gxjH12Wa9qjD6SiI8gLT0m_XxpGTvhKlET_cy0lrfnszshDTqLC1D8oGoVeALipTu9AgSyO3HYNd6m_WNKTZOnA_C7zAc5Um1UIXnR0sbcnciekh8Mm0VX9Zr58Ry0PVhJnNyjty13ClnNRz0YZPV0yo1E Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 9cd3cbe5f4c4466cac183fb444cce626 Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-VolumesGetTestJSON-909602105 Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:54:47.999169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:54:48.000923 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cd3cbe5f4c4466cac183fb444cce626"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cd3cbe5f4c4466cac183fb444cce626"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cd3cbe5f4c4466cac183fb444cce626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cd3cbe5f4c4466cac183fb444cce626"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:54:48.000923 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-VolumesGetTestJSON-909602105 Jul 18 10:54:48.000923 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 9cd3cbe5f4c4466cac183fb444cce626 Jul 18 10:54:48.000923 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-VolumesGetTestJSON-909602105 Jul 18 10:54:48.000923 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-VolumesGetTestJSON-909602105-project Jul 18 10:54:48.000923 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:54:48.000923 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:54:48.000923 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 6085a183c88b488e807c96d14be849f6 Jul 18 10:54:48.000923 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-VolumesGetTestJSON-909602105-project Jul 18 10:54:48.000923 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: Jul 18 10:54:48.000923 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Volume cf67bb53-7802-4845-9a22-19221edd4ff2 could not be found. Jul 18 10:54:48.000923 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': 'cf67bb53-7802-4845-9a22-19221edd4ff2'} Jul 18 10:54:48.000923 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cf67bb53-7802-4845-9a22-19221edd4ff2 could not be found. (HTTP 404) (Request-ID: req-53394687-d7e9-4d46-8a33-f441a3a955a4) Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:48.004119 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:54:48.005609 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cf67bb53-7802-4845-9a22-19221edd4ff2 could not be found. Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 10:54:48.006948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:54:48.008953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cf67bb53-7802-4845-9a22-19221edd4ff2 could not be found. Jul 18 10:54:48.008953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:48.008953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:54:48.008953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:48.008953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:54:48.008953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:54:48.008953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:54:48.008953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:54:48.008953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:54:48.008953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cf67bb53-7802-4845-9a22-19221edd4ff2 could not be found. Jul 18 10:54:48.008953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:54:48.008953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6188821a-7024-4521-a571-2845bf92ea0e tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] Returning 404 to user: Volume cf67bb53-7802-4845-9a22-19221edd4ff2 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:54:48.008953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6188821a-7024-4521-a571-2845bf92ea0e tempest-VolumesGetTestJSON-909602105 tempest-VolumesGetTestJSON-909602105-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2" status: 404 len: 109 microversion: 2.1 time: 0.041510 Jul 18 10:54:48.008953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 468/909] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:54:47 2022] GET /compute/v2.1/os-volumes/cf67bb53-7802-4845-9a22-19221edd4ff2 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:54:52.501199 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bd2a56e7-a532-408b-9af8-956a4c66d49b tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] Calling method '.version_select at 0x7f6364b49820>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:52.553094 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-bd2a56e7-a532-408b-9af8-956a4c66d49b tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/02157536-7592-48d7-ad57-c2cbe9e5fdc5" status: 200 len: 350 microversion: 2.1 time: 0.056187 Jul 18 10:54:52.553726 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 442/910] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:54:52 2022] GET /compute/v2.1/os-volumes/02157536-7592-48d7-ad57-c2cbe9e5fdc5 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:54.366126 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-48c25840-59ac-448a-a8ad-342657e44781 tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] Calling method '.version_select at 0x7f6364d4d1f0>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:54.416123 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-48c25840-59ac-448a-a8ad-342657e44781 tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/82994876-47e9-43c1-a477-cf0695559200" status: 200 len: 350 microversion: 2.1 time: 0.054575 Jul 18 10:54:54.416798 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 469/911] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:54:54 2022] GET /compute/v2.1/os-volumes/82994876-47e9-43c1-a477-cf0695559200 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:56.239721 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a6c06245-9f10-460d-8c5a-ba81ca797b5f tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] Calling method '.version_select at 0x7f6364b4a550>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:56.290620 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a6c06245-9f10-460d-8c5a-ba81ca797b5f tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/cedd4e41-a5d7-4c5c-bf28-f977b81286ad" status: 200 len: 351 microversion: 2.1 time: 0.055915 Jul 18 10:54:56.291197 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 443/912] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:54:56 2022] GET /compute/v2.1/os-volumes/cedd4e41-a5d7-4c5c-bf28-f977b81286ad => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:56.303645 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-00f024ee-4164-4ff8-9c41-dcbe4794d439 tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] Calling method '.version_select at 0x7f6365168c10>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:56.386149 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-00f024ee-4164-4ff8-9c41-dcbe4794d439 tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087389 Jul 18 10:54:56.386721 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 470/913] 10.222.0.49 () {58 vars in 1133 bytes} [Mon Jul 18 10:54:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:56.404440 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-1b47b6d9-7cb8-4916-adc6-edea03131402 tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] Calling method '.version_select at 0x7f6364b49550>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:56.490770 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-1b47b6d9-7cb8-4916-adc6-edea03131402 tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089968 Jul 18 10:54:56.491341 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 444/914] 10.222.0.49 () {58 vars in 1148 bytes} [Mon Jul 18 10:54:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:56.505492 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5d39d669-2cf4-445e-b35e-5fb6efb1b041 tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] Calling method '.version_select at 0x7f6364d4d8b0>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:56.598084 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5d39d669-2cf4-445e-b35e-5fb6efb1b041 tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.096617 Jul 18 10:54:56.605685 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 471/915] 10.222.0.49 () {58 vars in 1133 bytes} [Mon Jul 18 10:54:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:56.611437 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-dd8a3923-bf19-4ae9-9eb5-673793c2cfba tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] Calling method '.version_select at 0x7f6364c9aaf0>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:56.717666 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-dd8a3923-bf19-4ae9-9eb5-673793c2cfba tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091770 Jul 18 10:54:56.717666 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 445/916] 10.222.0.49 () {58 vars in 1166 bytes} [Mon Jul 18 10:54:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:56.724511 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-299b4e0f-42d3-43df-8783-9b9968def4db tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] Calling method '.version_select at 0x7f6364d0b670>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:56.822987 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-299b4e0f-42d3-43df-8783-9b9968def4db tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.103596 Jul 18 10:54:56.823576 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 472/917] 10.222.0.49 () {58 vars in 1169 bytes} [Mon Jul 18 10:54:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:56.843517 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-aeec0f26-2e4a-4807-b470-02bdb4002491 tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] Calling method '.version_select at 0x7f6364b374c0>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:56.939266 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-aeec0f26-2e4a-4807-b470-02bdb4002491 tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.106406 Jul 18 10:54:56.940376 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 446/918] 10.222.0.49 () {58 vars in 1154 bytes} [Mon Jul 18 10:54:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:54:56.952657 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d52f7686-fa21-4431-b72e-15159334a2a6 tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] Calling method '.version_select at 0x7f6364d9d8b0>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:57.047910 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d52f7686-fa21-4431-b72e-15159334a2a6 tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.099809 Jul 18 10:54:57.048481 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 473/919] 10.222.0.49 () {58 vars in 1187 bytes} [Mon Jul 18 10:54:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:54:57.060746 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-cc41b8d3-8c75-4540-b8d8-15fda8935dd4 tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] Calling method '.version_select at 0x7f6364b621f0>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:54:57.152737 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-cc41b8d3-8c75-4540-b8d8-15fda8935dd4 tempest-VolumesTestJSON-2147332144 tempest-VolumesTestJSON-2147332144-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.095783 Jul 18 10:54:57.153397 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 447/920] 10.222.0.49 () {58 vars in 1154 bytes} [Mon Jul 18 10:54:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:01.021534 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4ea89584-5185-4c5a-b10f-4f2d6944bbd1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:01.022520 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-4ea89584-5185-4c5a-b10f-4f2d6944bbd1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:01.029481 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4ea89584-5185-4c5a-b10f-4f2d6944bbd1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:01.029947 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4ea89584-5185-4c5a-b10f-4f2d6944bbd1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:01.030791 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4ea89584-5185-4c5a-b10f-4f2d6944bbd1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:01.031229 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4ea89584-5185-4c5a-b10f-4f2d6944bbd1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:01.062664 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4ea89584-5185-4c5a-b10f-4f2d6944bbd1 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045610 Jul 18 10:55:01.063109 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 474/921] 10.222.0.49 () {60 vars in 1342 bytes} [Mon Jul 18 10:55:01 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:01.128634 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c6ccea63-476b-40ef-89ae-a2786451e349 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:01.129348 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c6ccea63-476b-40ef-89ae-a2786451e349 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:01.135480 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c6ccea63-476b-40ef-89ae-a2786451e349 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:01.135929 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c6ccea63-476b-40ef-89ae-a2786451e349 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:01.136712 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c6ccea63-476b-40ef-89ae-a2786451e349 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:01.137177 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c6ccea63-476b-40ef-89ae-a2786451e349 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:01.162783 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c6ccea63-476b-40ef-89ae-a2786451e349 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Going to try to terminate instance {{(pid=125005) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:55:01.813410 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c6ccea63-476b-40ef-89ae-a2786451e349 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 204 len: 0 microversion: 2.20 time: 0.689941 Jul 18 10:55:01.814230 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 448/922] 10.222.0.49 () {60 vars in 1279 bytes} [Mon Jul 18 10:55:01 2022] DELETE /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 0 bytes in 692 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 10:55:01.825471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3646d97e-5d3e-46eb-93e6-ee8e06298523 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:01.826098 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3646d97e-5d3e-46eb-93e6-ee8e06298523 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:01.837579 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3646d97e-5d3e-46eb-93e6-ee8e06298523 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:01.843075 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3646d97e-5d3e-46eb-93e6-ee8e06298523 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:01.843889 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3646d97e-5d3e-46eb-93e6-ee8e06298523 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:01.844330 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3646d97e-5d3e-46eb-93e6-ee8e06298523 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:02.014877 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3646d97e-5d3e-46eb-93e6-ee8e06298523 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:02.025656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3646d97e-5d3e-46eb-93e6-ee8e06298523 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:02.027183 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3646d97e-5d3e-46eb-93e6-ee8e06298523 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:02.028617 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3646d97e-5d3e-46eb-93e6-ee8e06298523 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1722 microversion: 2.20 time: 0.208758 Jul 18 10:55:02.029358 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 475/923] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:55:01 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:55:03.048144 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9a2c85e8-258a-4cb1-84a8-ea5959163e7a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:03.048799 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-9a2c85e8-258a-4cb1-84a8-ea5959163e7a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:03.056571 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9a2c85e8-258a-4cb1-84a8-ea5959163e7a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:03.057117 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9a2c85e8-258a-4cb1-84a8-ea5959163e7a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:03.057968 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9a2c85e8-258a-4cb1-84a8-ea5959163e7a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:03.058422 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9a2c85e8-258a-4cb1-84a8-ea5959163e7a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:03.212043 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9a2c85e8-258a-4cb1-84a8-ea5959163e7a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:03.221413 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9a2c85e8-258a-4cb1-84a8-ea5959163e7a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:03.223187 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9a2c85e8-258a-4cb1-84a8-ea5959163e7a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:03.224580 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9a2c85e8-258a-4cb1-84a8-ea5959163e7a tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1722 microversion: 2.20 time: 0.180816 Jul 18 10:55:03.225163 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 449/924] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:55:03 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:55:04.242756 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-147caf22-7081-4c44-b111-a549ed341446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:04.243367 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-147caf22-7081-4c44-b111-a549ed341446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:04.249964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-147caf22-7081-4c44-b111-a549ed341446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:04.250517 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-147caf22-7081-4c44-b111-a549ed341446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:04.251302 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-147caf22-7081-4c44-b111-a549ed341446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:04.251736 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-147caf22-7081-4c44-b111-a549ed341446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:04.329980 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-147caf22-7081-4c44-b111-a549ed341446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:04.339957 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-147caf22-7081-4c44-b111-a549ed341446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:04.341516 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-147caf22-7081-4c44-b111-a549ed341446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:04.342968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-147caf22-7081-4c44-b111-a549ed341446 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1655 microversion: 2.20 time: 0.104256 Jul 18 10:55:04.344056 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 476/925] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:55:04 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1655 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:55:04.623927 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-b7c21051-908c-4728-982c-63f90528be77 req-d3591b7b-385a-4ce5-8e75-1d29122f52e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1b361f-a048-4231-8c87-b3b27c478f7d", "name": "network-vif-deleted", "tag": "e168237a-b0b4-42cb-8c89-d5ade5d9cf57"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:55:04.633074 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-b7c21051-908c-4728-982c-63f90528be77 req-d3591b7b-385a-4ce5-8e75-1d29122f52e9 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:04.634199 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-b7c21051-908c-4728-982c-63f90528be77 req-d3591b7b-385a-4ce5-8e75-1d29122f52e9 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:04.646499 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-b7c21051-908c-4728-982c-63f90528be77 req-d3591b7b-385a-4ce5-8e75-1d29122f52e9 service nova] Creating event network-vif-deleted:e168237a-b0b4-42cb-8c89-d5ade5d9cf57 for instance 4f1b361f-a048-4231-8c87-b3b27c478f7d on hv-cinder-84949 Jul 18 10:55:04.651649 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-b7c21051-908c-4728-982c-63f90528be77 req-d3591b7b-385a-4ce5-8e75-1d29122f52e9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031826 Jul 18 10:55:04.652150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 450/926] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:05.363834 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-12f94ae0-022e-48ec-b508-f08f9c750008 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:05.364465 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-12f94ae0-022e-48ec-b508-f08f9c750008 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:05.371654 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-12f94ae0-022e-48ec-b508-f08f9c750008 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:05.372105 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-12f94ae0-022e-48ec-b508-f08f9c750008 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:05.377588 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-12f94ae0-022e-48ec-b508-f08f9c750008 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:05.377588 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-12f94ae0-022e-48ec-b508-f08f9c750008 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:05.407515 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-12f94ae0-022e-48ec-b508-f08f9c750008 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:05.407993 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-12f94ae0-022e-48ec-b508-f08f9c750008 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:05.409059 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-12f94ae0-022e-48ec-b508-f08f9c750008 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lazy-loading 'fault' on Instance uuid 4f1b361f-a048-4231-8c87-b3b27c478f7d {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:55:05.453346 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-12f94ae0-022e-48ec-b508-f08f9c750008 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:05.481017 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-12f94ae0-022e-48ec-b508-f08f9c750008 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:05.481017 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-12f94ae0-022e-48ec-b508-f08f9c750008 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e032c8e5b024fa7a41cd1090e0f1ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48497435674b41ccb34f6ff43026a232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:05.481017 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-12f94ae0-022e-48ec-b508-f08f9c750008 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 200 len: 1372 microversion: 2.20 time: 0.107594 Jul 18 10:55:05.481567 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 477/927] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:55:05 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:55:06.498941 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e7805e4b-b67e-48a4-93f5-e5b7d53f0f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:06.499748 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e7805e4b-b67e-48a4-93f5-e5b7d53f0f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:06.507701 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e7805e4b-b67e-48a4-93f5-e5b7d53f0f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:06.508146 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e7805e4b-b67e-48a4-93f5-e5b7d53f0f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:06.508948 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e7805e4b-b67e-48a4-93f5-e5b7d53f0f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:06.509375 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e7805e4b-b67e-48a4-93f5-e5b7d53f0f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:06.523459 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-e7805e4b-b67e-48a4-93f5-e5b7d53f0f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] HTTP exception thrown: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e7805e4b-b67e-48a4-93f5-e5b7d53f0f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Request method failure captured: Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d HTTP/1.1 Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1To3O2fmmtSjU_HkOy8YHM_7tWfsIx_ZuUjyiG8wWFD1uvcFvJCOhVb6O9czo_URO0KWmSEgLogMyxbYkgGg6jOeHyJfOlZ8Zwi8pitLbpLHfRXJxXkJsrp3UDjRwsunM_lQ-edIQN56EpNRA45WJzZBDX-ueRIcHFw5T6UQrsp-WP8 Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 48497435674b41ccb34f6ff43026a232 Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:55:06.525258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:55:06.527209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/48497435674b41ccb34f6ff43026a232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_48497435674b41ccb34f6ff43026a232"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/48497435674b41ccb34f6ff43026a232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/48497435674b41ccb34f6ff43026a232"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:55:06.527209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:55:06.527209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 48497435674b41ccb34f6ff43026a232 Jul 18 10:55:06.527209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:55:06.527209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-AttachVolumeShelveTestJSON-41570772-project Jul 18 10:55:06.527209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:55:06.527209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:55:06.527209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 7e032c8e5b024fa7a41cd1090e0f1ada Jul 18 10:55:06.527209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-AttachVolumeShelveTestJSON-41570772-project Jul 18 10:55:06.527209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:55:06.527209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. Jul 18 10:55:06.527209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '4f1b361f-a048-4231-8c87-b3b27c478f7d'} Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:55:06.528190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. Jul 18 10:55:06.529538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:55:06.530941 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e7805e4b-b67e-48a4-93f5-e5b7d53f0f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Returning 404 to user: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:55:06.530941 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e7805e4b-b67e-48a4-93f5-e5b7d53f0f56 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 404 len: 111 microversion: 2.20 time: 0.032733 Jul 18 10:55:06.530941 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 451/928] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:55:06 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:55:06.536695 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-1ff5b3f2-dba7-4cd0-bf1f-06ebcccdfa75 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '.version_select at 0x7f6364d4d4c0>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:06.682759 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-1ff5b3f2-dba7-4cd0-bf1f-06ebcccdfa75 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683906143" status: 204 len: 0 microversion: 2.20 time: 0.150514 Jul 18 10:55:06.683336 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 478/929] 10.222.0.49 () {60 vars in 1261 bytes} [Mon Jul 18 10:55:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683906143 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 10:55:09.003258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b1be855d-390e-4e4f-8258-2d02aca9d55b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:09.003855 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b1be855d-390e-4e4f-8258-2d02aca9d55b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:09.010450 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b1be855d-390e-4e4f-8258-2d02aca9d55b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:09.010892 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b1be855d-390e-4e4f-8258-2d02aca9d55b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:09.011655 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b1be855d-390e-4e4f-8258-2d02aca9d55b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:09.012115 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b1be855d-390e-4e4f-8258-2d02aca9d55b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:09.025910 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-b1be855d-390e-4e4f-8258-2d02aca9d55b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] HTTP exception thrown: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b1be855d-390e-4e4f-8258-2d02aca9d55b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Request method failure captured: Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: DELETE /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d HTTP/1.1 Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1To3O2fmmtSjU_HkOy8YHM_7tWfsIx_ZuUjyiG8wWFD1uvcFvJCOhVb6O9czo_URO0KWmSEgLogMyxbYkgGg6jOeHyJfOlZ8Zwi8pitLbpLHfRXJxXkJsrp3UDjRwsunM_lQ-edIQN56EpNRA45WJzZBDX-ueRIcHFw5T6UQrsp-WP8 Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 48497435674b41ccb34f6ff43026a232 Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:55:09.027552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:55:09.029155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/48497435674b41ccb34f6ff43026a232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_48497435674b41ccb34f6ff43026a232"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/48497435674b41ccb34f6ff43026a232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/48497435674b41ccb34f6ff43026a232"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:55:09.029155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:55:09.029155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 48497435674b41ccb34f6ff43026a232 Jul 18 10:55:09.029155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:55:09.029155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-AttachVolumeShelveTestJSON-41570772-project Jul 18 10:55:09.029155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:55:09.029155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:55:09.029155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 7e032c8e5b024fa7a41cd1090e0f1ada Jul 18 10:55:09.029155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-AttachVolumeShelveTestJSON-41570772-project Jul 18 10:55:09.029155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:55:09.029155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. Jul 18 10:55:09.029155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '4f1b361f-a048-4231-8c87-b3b27c478f7d'} Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:55:09.029972 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. Jul 18 10:55:09.031292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:55:09.032924 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b1be855d-390e-4e4f-8258-2d02aca9d55b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Returning 404 to user: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:55:09.032924 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b1be855d-390e-4e4f-8258-2d02aca9d55b tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 404 len: 111 microversion: 2.20 time: 0.030020 Jul 18 10:55:09.032924 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 452/930] 10.222.0.49 () {60 vars in 1279 bytes} [Mon Jul 18 10:55:08 2022] DELETE /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:55:09.038749 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3569cdf7-3fd7-4d39-b0f2-6829706a2558 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:09.039436 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3569cdf7-3fd7-4d39-b0f2-6829706a2558 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 4f1b361f-a048-4231-8c87-b3b27c478f7d] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:09.046873 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3569cdf7-3fd7-4d39-b0f2-6829706a2558 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:09.047323 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3569cdf7-3fd7-4d39-b0f2-6829706a2558 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:09.048183 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3569cdf7-3fd7-4d39-b0f2-6829706a2558 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:09.048624 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3569cdf7-3fd7-4d39-b0f2-6829706a2558 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-3569cdf7-3fd7-4d39-b0f2-6829706a2558 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] HTTP exception thrown: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3569cdf7-3fd7-4d39-b0f2-6829706a2558 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Request method failure captured: Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d HTTP/1.1 Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To3O2fmmtSjU_HkOy8YHM_7tWfsIx_ZuUjyiG8wWFD1uvcFvJCOhVb6O9czo_URO0KWmSEgLogMyxbYkgGg6jOeHyJfOlZ8Zwi8pitLbpLHfRXJxXkJsrp3UDjRwsunM_lQ-edIQN56EpNRA45WJzZBDX-ueRIcHFw5T6UQrsp-WP8 Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 48497435674b41ccb34f6ff43026a232 Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:55:09.066621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:55:09.068435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/48497435674b41ccb34f6ff43026a232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_48497435674b41ccb34f6ff43026a232"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/48497435674b41ccb34f6ff43026a232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/48497435674b41ccb34f6ff43026a232"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:55:09.068435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:55:09.068435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 48497435674b41ccb34f6ff43026a232 Jul 18 10:55:09.068435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:55:09.068435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeShelveTestJSON-41570772-project Jul 18 10:55:09.068435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:55:09.068435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:55:09.068435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 7e032c8e5b024fa7a41cd1090e0f1ada Jul 18 10:55:09.068435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeShelveTestJSON-41570772-project Jul 18 10:55:09.068435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:55:09.068435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. Jul 18 10:55:09.068435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '4f1b361f-a048-4231-8c87-b3b27c478f7d'} Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:55:09.069376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. Jul 18 10:55:09.070959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:09.072252 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3569cdf7-3fd7-4d39-b0f2-6829706a2558 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Returning 404 to user: Instance 4f1b361f-a048-4231-8c87-b3b27c478f7d could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:55:09.072252 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3569cdf7-3fd7-4d39-b0f2-6829706a2558 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d" status: 404 len: 111 microversion: 2.20 time: 0.032658 Jul 18 10:55:09.072252 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 479/931] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:55:09 2022] GET /compute/v2.1/servers/4f1b361f-a048-4231-8c87-b3b27c478f7d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:55:10.436630 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-de5a4eef-6012-4e80-8c52-9bb2ee5ed068 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:10.437226 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-de5a4eef-6012-4e80-8c52-9bb2ee5ed068 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:10.447452 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-de5a4eef-6012-4e80-8c52-9bb2ee5ed068 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:10.448256 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-de5a4eef-6012-4e80-8c52-9bb2ee5ed068 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:10.449703 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-de5a4eef-6012-4e80-8c52-9bb2ee5ed068 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:10.450518 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-de5a4eef-6012-4e80-8c52-9bb2ee5ed068 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:10.468390 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-de5a4eef-6012-4e80-8c52-9bb2ee5ed068 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] HTTP exception thrown: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-de5a4eef-6012-4e80-8c52-9bb2ee5ed068 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Request method failure captured: Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: DELETE /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e HTTP/1.1 Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1To3O2fmmtSjU_HkOy8YHM_7tWfsIx_ZuUjyiG8wWFD1uvcFvJCOhVb6O9czo_URO0KWmSEgLogMyxbYkgGg6jOeHyJfOlZ8Zwi8pitLbpLHfRXJxXkJsrp3UDjRwsunM_lQ-edIQN56EpNRA45WJzZBDX-ueRIcHFw5T6UQrsp-WP8 Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 48497435674b41ccb34f6ff43026a232 Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:55:10.470095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:55:10.472342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/48497435674b41ccb34f6ff43026a232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_48497435674b41ccb34f6ff43026a232"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/48497435674b41ccb34f6ff43026a232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/48497435674b41ccb34f6ff43026a232"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:55:10.472342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:55:10.472342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 48497435674b41ccb34f6ff43026a232 Jul 18 10:55:10.472342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:55:10.472342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-AttachVolumeShelveTestJSON-41570772-project Jul 18 10:55:10.472342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:55:10.472342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:55:10.472342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 7e032c8e5b024fa7a41cd1090e0f1ada Jul 18 10:55:10.472342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-AttachVolumeShelveTestJSON-41570772-project Jul 18 10:55:10.472342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:55:10.472342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. Jul 18 10:55:10.472342 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '14d05192-b009-41ab-861b-b66d0352d41e'} Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:55:10.473250 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. Jul 18 10:55:10.474885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:55:10.477842 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-de5a4eef-6012-4e80-8c52-9bb2ee5ed068 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Returning 404 to user: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:55:10.477842 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-de5a4eef-6012-4e80-8c52-9bb2ee5ed068 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "DELETE /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 404 len: 111 microversion: 2.20 time: 0.039414 Jul 18 10:55:10.477842 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 453/932] 10.222.0.49 () {60 vars in 1279 bytes} [Mon Jul 18 10:55:10 2022] DELETE /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:55:10.481701 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d6d89569-f6c8-4543-b6d5-553717cb5e20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:10.482357 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d6d89569-f6c8-4543-b6d5-553717cb5e20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] [instance: 14d05192-b009-41ab-861b-b66d0352d41e] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:10.492821 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6d89569-f6c8-4543-b6d5-553717cb5e20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:10.492821 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6d89569-f6c8-4543-b6d5-553717cb5e20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:10.492821 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6d89569-f6c8-4543-b6d5-553717cb5e20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:10.492821 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6d89569-f6c8-4543-b6d5-553717cb5e20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:10.507641 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-d6d89569-f6c8-4543-b6d5-553717cb5e20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] HTTP exception thrown: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d6d89569-f6c8-4543-b6d5-553717cb5e20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Request method failure captured: Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e HTTP/1.1 Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1To3O2fmmtSjU_HkOy8YHM_7tWfsIx_ZuUjyiG8wWFD1uvcFvJCOhVb6O9czo_URO0KWmSEgLogMyxbYkgGg6jOeHyJfOlZ8Zwi8pitLbpLHfRXJxXkJsrp3UDjRwsunM_lQ-edIQN56EpNRA45WJzZBDX-ueRIcHFw5T6UQrsp-WP8 Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 48497435674b41ccb34f6ff43026a232 Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:55:10.509419 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:55:10.510865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/48497435674b41ccb34f6ff43026a232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_48497435674b41ccb34f6ff43026a232"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/48497435674b41ccb34f6ff43026a232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/48497435674b41ccb34f6ff43026a232"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:55:10.510865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:55:10.510865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 48497435674b41ccb34f6ff43026a232 Jul 18 10:55:10.510865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-41570772 Jul 18 10:55:10.510865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-AttachVolumeShelveTestJSON-41570772-project Jul 18 10:55:10.510865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:55:10.510865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:55:10.510865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 7e032c8e5b024fa7a41cd1090e0f1ada Jul 18 10:55:10.510865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-AttachVolumeShelveTestJSON-41570772-project Jul 18 10:55:10.510865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:55:10.510865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. Jul 18 10:55:10.510865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '14d05192-b009-41ab-861b-b66d0352d41e'} Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:55:10.511618 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. Jul 18 10:55:10.513200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:10.514744 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d6d89569-f6c8-4543-b6d5-553717cb5e20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] Returning 404 to user: Instance 14d05192-b009-41ab-861b-b66d0352d41e could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:55:10.514744 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d6d89569-f6c8-4543-b6d5-553717cb5e20 tempest-AttachVolumeShelveTestJSON-41570772 tempest-AttachVolumeShelveTestJSON-41570772-project] 10.222.0.49 "GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e" status: 404 len: 111 microversion: 2.20 time: 0.033367 Jul 18 10:55:10.514744 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 480/933] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 18 10:55:10 2022] GET /compute/v2.1/servers/14d05192-b009-41ab-861b-b66d0352d41e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:55:17.128916 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-49d4ad65-6d1b-47ea-969e-72dd869128c5 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Action: 'create', calling method: .version_select at 0x7f6364c29430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1654326333"}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:55:18.178184 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-49d4ad65-6d1b-47ea-969e-72dd869128c5 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.208316 Jul 18 10:55:18.179120 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 454/934] 10.222.0.49 () {60 vars in 1154 bytes} [Mon Jul 18 10:55:16 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1210 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 10:55:18.190065 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-7004fedf-4802-4655-9ab7-9fb5ab832fa8 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364d4d1f0>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:18.246546 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-7004fedf-4802-4655-9ab7-9fb5ab832fa8 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657" status: 200 len: 345 microversion: 2.1 time: 0.060506 Jul 18 10:55:18.247142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 481/935] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:55:18 2022] GET /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:55:19.262278 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-dfeb2306-a8d5-440c-94cd-bcbd8bb24b2a tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364b80160>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:19.407048 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-dfeb2306-a8d5-440c-94cd-bcbd8bb24b2a tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657" status: 200 len: 346 microversion: 2.1 time: 0.150230 Jul 18 10:55:19.407951 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 455/936] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:55:19 2022] GET /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 => generated 346 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:19.426536 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-21a5db79-7798-410f-bc04-9b45ae359056 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Action: 'create', calling method: .version_select at 0x7f6364b92670>, body: {"snapshot": {"volume_id": "ec2f55cb-e0c9-4313-bb5e-fe764b5e7657", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1677646488"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:55:20.031455 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-21a5db79-7798-410f-bc04-9b45ae359056 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.615854 Jul 18 10:55:20.032016 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 482/937] 10.222.0.49 () {60 vars in 1161 bytes} [Mon Jul 18 10:55:19 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:20.043042 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-be5ebcac-5e9f-4aae-acc2-46477f6537f8 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364b495e0>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:20.073419 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-be5ebcac-5e9f-4aae-acc2-46477f6537f8 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555" status: 200 len: 287 microversion: 2.1 time: 0.034196 Jul 18 10:55:20.074053 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 456/938] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 18 10:55:20 2022] GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:20.085121 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-cdecd1a7-f5c0-4536-8a7e-b39930b5c667 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364d15430>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:20.114768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-cdecd1a7-f5c0-4536-8a7e-b39930b5c667 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034629 Jul 18 10:55:20.120254 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 483/939] 10.222.0.49 () {58 vars in 1139 bytes} [Mon Jul 18 10:55:20 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:20.125639 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-4d7e42d2-59e7-45e5-a5ae-613f607e729b tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364b948b0>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:20.165150 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-4d7e42d2-59e7-45e5-a5ae-613f607e729b tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555" status: 200 len: 287 microversion: 2.1 time: 0.043053 Jul 18 10:55:20.166378 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 457/940] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 18 10:55:20 2022] GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:21.174862 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:21.175696 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=30 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:21.179719 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-c0a81f2d-f95f-44ca-bf3a-02db1bfef38f tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364af3f70>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:21.215350 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-c0a81f2d-f95f-44ca-bf3a-02db1bfef38f tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555" status: 200 len: 287 microversion: 2.1 time: 0.042455 Jul 18 10:55:21.215959 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 484/941] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 18 10:55:21 2022] GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:22.225256 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:22.226055 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:22.230159 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-92474478-f7ab-4c6c-af20-f658b8ea24b7 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364be8e50>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:22.263620 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-92474478-f7ab-4c6c-af20-f658b8ea24b7 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555" status: 200 len: 287 microversion: 2.1 time: 0.039732 Jul 18 10:55:22.264239 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 458/942] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 18 10:55:22 2022] GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:23.277534 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-82e800b7-92d3-444b-8e33-925b007e71e9 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364b87820>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:23.311941 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-82e800b7-92d3-444b-8e33-925b007e71e9 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555" status: 200 len: 287 microversion: 2.1 time: 0.038890 Jul 18 10:55:23.319421 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 485/943] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 18 10:55:23 2022] GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:24.327603 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-484a3b1d-c0c9-46c3-a75d-1af67a824e83 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364b494c0>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:24.357950 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-484a3b1d-c0c9-46c3-a75d-1af67a824e83 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555" status: 200 len: 287 microversion: 2.1 time: 0.035291 Jul 18 10:55:24.358606 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 459/944] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 18 10:55:24 2022] GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:25.371711 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-928872f9-1d21-4b4d-bdab-1daf7a921bf1 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364b92940>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:25.403040 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-928872f9-1d21-4b4d-bdab-1daf7a921bf1 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555" status: 200 len: 288 microversion: 2.1 time: 0.035474 Jul 18 10:55:25.403438 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 486/945] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 18 10:55:25 2022] GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:25.415403 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-fd7845a5-5ed7-4ffd-8d3f-b72c555965bf tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364b80940>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:25.632843 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-fd7845a5-5ed7-4ffd-8d3f-b72c555965bf tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555" status: 202 len: 0 microversion: 2.1 time: 0.222109 Jul 18 10:55:25.633419 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 460/946] 10.222.0.49 () {58 vars in 1253 bytes} [Mon Jul 18 10:55:25 2022] DELETE /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:55:25.641681 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4cf2dd0b-c803-4673-8a89-7f997a44d8cb tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364bf2820>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:25.671673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4cf2dd0b-c803-4673-8a89-7f997a44d8cb tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555" status: 200 len: 287 microversion: 2.1 time: 0.033883 Jul 18 10:55:25.672339 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 487/947] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 18 10:55:25 2022] GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:26.692803 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-cf7851c9-d58c-4ce6-95a7-3dd01816ef2e tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364af9820>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:26.723564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-cf7851c9-d58c-4ce6-95a7-3dd01816ef2e tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555" status: 200 len: 287 microversion: 2.1 time: 0.035725 Jul 18 10:55:26.724153 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 461/948] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 18 10:55:26 2022] GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:27.736398 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4c2af05b-ca80-484b-907f-5799570a7553 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364d4d4c0>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:27.762145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-4c2af05b-ca80-484b-907f-5799570a7553 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] HTTP exception thrown: Snapshot 768e4928-3e01-4bd6-9c6c-0597cc413555 could not be found. Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4c2af05b-ca80-484b-907f-5799570a7553 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Request method failure captured: Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555 HTTP/1.1 Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1TwUib7fG6ojN5zW1Sty9oMJGgtSqpYnuk40sgLo69GJhgmLuEnAJgo23rHBTHeCtKkZWl9CFJIPThyhDHp8Dzedt-8zNTFI821z3T3WkATLjBHwKsPXVFA3nTdsuHMPeLsXhvoRTwZkQ02ktc44ATIg6LMuqeZU3iFf_cQX4MO0Jjc Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 61a2df2a0e8e48f1bdc613750e16eca6 Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-561447217 Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:55:27.764342 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:55:27.765933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:55:27.765933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-VolumesSnapshotsTestJSON-561447217 Jul 18 10:55:27.765933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 61a2df2a0e8e48f1bdc613750e16eca6 Jul 18 10:55:27.765933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-561447217 Jul 18 10:55:27.765933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-VolumesSnapshotsTestJSON-561447217-project Jul 18 10:55:27.765933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:55:27.765933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:55:27.765933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 2a536e4b20f04a8bbdcd77c6d8bfcd16 Jul 18 10:55:27.765933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-VolumesSnapshotsTestJSON-561447217-project Jul 18 10:55:27.765933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: Jul 18 10:55:27.765933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Snapshot 768e4928-3e01-4bd6-9c6c-0597cc413555 could not be found. Jul 18 10:55:27.765933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '768e4928-3e01-4bd6-9c6c-0597cc413555'} Jul 18 10:55:27.765933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 768e4928-3e01-4bd6-9c6c-0597cc413555 could not be found. (HTTP 404) (Request-ID: req-c8084017-0026-482b-87cb-41b71e60bfe5) Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:27.767416 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:55:27.768843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 768e4928-3e01-4bd6-9c6c-0597cc413555 could not be found. Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 18 10:55:27.770373 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:55:27.771900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 768e4928-3e01-4bd6-9c6c-0597cc413555 could not be found. Jul 18 10:55:27.771900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:27.771900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:27.771900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:27.771900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:27.771900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:27.771900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:27.771900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:55:27.771900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:55:27.771900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 768e4928-3e01-4bd6-9c6c-0597cc413555 could not be found. Jul 18 10:55:27.771900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:27.771900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4c2af05b-ca80-484b-907f-5799570a7553 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Returning 404 to user: Snapshot 768e4928-3e01-4bd6-9c6c-0597cc413555 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:55:27.771900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4c2af05b-ca80-484b-907f-5799570a7553 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555" status: 404 len: 111 microversion: 2.1 time: 0.034045 Jul 18 10:55:27.771900 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 488/949] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 18 10:55:27 2022] GET /compute/v2.1/os-snapshots/768e4928-3e01-4bd6-9c6c-0597cc413555 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:55:27.775375 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-4f38963d-8628-4782-9052-dc0a0af8a61a tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364b80310>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:28.036169 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-4f38963d-8628-4782-9052-dc0a0af8a61a tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657" status: 202 len: 0 microversion: 2.1 time: 0.264499 Jul 18 10:55:28.036740 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 462/950] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 18 10:55:27 2022] DELETE /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:55:28.045896 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-b12b1bbb-d023-4f10-ad97-e3400ba81a1f tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364af34c0>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:28.096545 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-b12b1bbb-d023-4f10-ad97-e3400ba81a1f tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657" status: 200 len: 345 microversion: 2.1 time: 0.055236 Jul 18 10:55:28.097142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 489/951] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:55:28 2022] GET /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:28.860301 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1275941554", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1612637408", "security_groups": [{"name": "tempest-secgroup-smoke-1718855347"}], "block_device_mapping_v2": [{"uuid": "ee433857-e8f9-4740-9bdd-8ccd8bd9d87f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "407e895d-8435-43cb-addb-b40e755d1f02"}]}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:55:28.994290 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.network.neutron [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] validate_networks() for [('407e895d-8435-43cb-addb-b40e755d1f02', None, None, None, None, None)] {{(pid=125005) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:55:29.111165 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-682d9c46-0482-4b15-87c2-d1c4656e26e7 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364d153a0>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:29.141434 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-682d9c46-0482-4b15-87c2-d1c4656e26e7 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] HTTP exception thrown: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-682d9c46-0482-4b15-87c2-d1c4656e26e7 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Request method failure captured: Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 HTTP/1.1 Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1TwUib7fG6ojN5zW1Sty9oMJGgtSqpYnuk40sgLo69GJhgmLuEnAJgo23rHBTHeCtKkZWl9CFJIPThyhDHp8Dzedt-8zNTFI821z3T3WkATLjBHwKsPXVFA3nTdsuHMPeLsXhvoRTwZkQ02ktc44ATIg6LMuqeZU3iFf_cQX4MO0Jjc Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 61a2df2a0e8e48f1bdc613750e16eca6 Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-561447217 Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:55:29.143591 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:55:29.145212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:55:29.145212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-VolumesSnapshotsTestJSON-561447217 Jul 18 10:55:29.145212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 61a2df2a0e8e48f1bdc613750e16eca6 Jul 18 10:55:29.145212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-561447217 Jul 18 10:55:29.145212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-VolumesSnapshotsTestJSON-561447217-project Jul 18 10:55:29.145212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:55:29.145212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:55:29.145212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 2a536e4b20f04a8bbdcd77c6d8bfcd16 Jul 18 10:55:29.145212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-VolumesSnapshotsTestJSON-561447217-project Jul 18 10:55:29.145212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: Jul 18 10:55:29.145212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. Jul 18 10:55:29.145212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': 'ec2f55cb-e0c9-4313-bb5e-fe764b5e7657'} Jul 18 10:55:29.145212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. (HTTP 404) (Request-ID: req-baaf99c1-25b6-462e-8d3f-60a0e2f1a0f8) Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:29.146283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:55:29.147839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 10:55:29.149177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:55:29.150622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. Jul 18 10:55:29.150622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.150622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:29.150622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.150622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:29.150622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:29.150622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:29.150622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:55:29.150622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:55:29.150622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. Jul 18 10:55:29.150622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.150622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-682d9c46-0482-4b15-87c2-d1c4656e26e7 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Returning 404 to user: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:55:29.151797 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-682d9c46-0482-4b15-87c2-d1c4656e26e7 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657" status: 404 len: 109 microversion: 2.1 time: 0.045580 Jul 18 10:55:29.152451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 490/952] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:55:29 2022] GET /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:55:29.167596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-db711877-d7d3-4b14-a220-bca420b57f89 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364d4a940>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:29.203280 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-db711877-d7d3-4b14-a220-bca420b57f89 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] HTTP exception thrown: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-db711877-d7d3-4b14-a220-bca420b57f89 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Request method failure captured: Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: DELETE /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 HTTP/1.1 Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1TwUib7fG6ojN5zW1Sty9oMJGgtSqpYnuk40sgLo69GJhgmLuEnAJgo23rHBTHeCtKkZWl9CFJIPThyhDHp8Dzedt-8zNTFI821z3T3WkATLjBHwKsPXVFA3nTdsuHMPeLsXhvoRTwZkQ02ktc44ATIg6LMuqeZU3iFf_cQX4MO0Jjc Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 61a2df2a0e8e48f1bdc613750e16eca6 Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-561447217 Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:55:29.205349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:55:29.206996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:55:29.206996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-VolumesSnapshotsTestJSON-561447217 Jul 18 10:55:29.206996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 61a2df2a0e8e48f1bdc613750e16eca6 Jul 18 10:55:29.206996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-561447217 Jul 18 10:55:29.206996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-VolumesSnapshotsTestJSON-561447217-project Jul 18 10:55:29.206996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:55:29.206996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:55:29.206996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 2a536e4b20f04a8bbdcd77c6d8bfcd16 Jul 18 10:55:29.206996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-VolumesSnapshotsTestJSON-561447217-project Jul 18 10:55:29.206996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: Jul 18 10:55:29.206996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. Jul 18 10:55:29.206996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': 'ec2f55cb-e0c9-4313-bb5e-fe764b5e7657'} Jul 18 10:55:29.206996 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. (HTTP 404) (Request-ID: req-8f9d03e1-59f2-4d1b-893c-9c73290ef1b8) Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:29.207970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:55:29.209318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 10:55:29.210738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:55:29.212106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. Jul 18 10:55:29.212106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.212106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:29.212106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.212106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:29.212106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:29.212106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:29.212106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:55:29.212106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:55:29.212106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. Jul 18 10:55:29.212106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.212106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-db711877-d7d3-4b14-a220-bca420b57f89 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Returning 404 to user: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:55:29.212106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-db711877-d7d3-4b14-a220-bca420b57f89 tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657" status: 404 len: 109 microversion: 2.1 time: 0.043518 Jul 18 10:55:29.212106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 491/953] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 18 10:55:29 2022] DELETE /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:55:29.215739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-56a62c12-ccaa-43b1-bb79-ca79f6d7a80c tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Calling method '.version_select at 0x7f6364d4d0d0>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:29.268296 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-56a62c12-ccaa-43b1-bb79-ca79f6d7a80c tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] HTTP exception thrown: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-56a62c12-ccaa-43b1-bb79-ca79f6d7a80c tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Request method failure captured: Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 HTTP/1.1 Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1TwUib7fG6ojN5zW1Sty9oMJGgtSqpYnuk40sgLo69GJhgmLuEnAJgo23rHBTHeCtKkZWl9CFJIPThyhDHp8Dzedt-8zNTFI821z3T3WkATLjBHwKsPXVFA3nTdsuHMPeLsXhvoRTwZkQ02ktc44ATIg6LMuqeZU3iFf_cQX4MO0Jjc Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 61a2df2a0e8e48f1bdc613750e16eca6 Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-561447217 Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:55:29.270376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:55:29.271964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/61a2df2a0e8e48f1bdc613750e16eca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:55:29.271964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-VolumesSnapshotsTestJSON-561447217 Jul 18 10:55:29.271964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 61a2df2a0e8e48f1bdc613750e16eca6 Jul 18 10:55:29.271964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-561447217 Jul 18 10:55:29.271964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-VolumesSnapshotsTestJSON-561447217-project Jul 18 10:55:29.271964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:55:29.271964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:55:29.271964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 2a536e4b20f04a8bbdcd77c6d8bfcd16 Jul 18 10:55:29.271964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-VolumesSnapshotsTestJSON-561447217-project Jul 18 10:55:29.271964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: Jul 18 10:55:29.271964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. Jul 18 10:55:29.271964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': 'ec2f55cb-e0c9-4313-bb5e-fe764b5e7657'} Jul 18 10:55:29.271964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. (HTTP 404) (Request-ID: req-38ce3be5-e3a8-4605-8d94-2f36232bd165) Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:29.273022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:55:29.274186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 10:55:29.275347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:55:29.276574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. Jul 18 10:55:29.276574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.276574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:29.276574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.276574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:29.276574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:29.276574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:29.276574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:55:29.276574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:55:29.276574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. Jul 18 10:55:29.276574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:29.276574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-56a62c12-ccaa-43b1-bb79-ca79f6d7a80c tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] Returning 404 to user: Volume ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:55:29.276574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-56a62c12-ccaa-43b1-bb79-ca79f6d7a80c tempest-VolumesSnapshotsTestJSON-561447217 tempest-VolumesSnapshotsTestJSON-561447217-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657" status: 404 len: 109 microversion: 2.1 time: 0.060234 Jul 18 10:55:29.276574 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 492/954] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 18 10:55:29 2022] GET /compute/v2.1/os-volumes/ec2f55cb-e0c9-4313-bb5e-fe764b5e7657 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:55:29.452156 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Flavor limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:55:29.452555 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Image limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:55:29.453079 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Flavor pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:55:29.453494 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Image pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:55:29.454026 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:55:29.464088 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:29.464526 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:29.465346 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:29.465772 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:29.483186 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Getting quotas for project 17f436162f3a4bd4b3a94f584e7d8782. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:55:29.487601 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Getting quotas for user eb483b1aee944da8910dd7468a0ef4ac and project 17f436162f3a4bd4b3a94f584e7d8782. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:55:29.549540 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Going to run 1 instances... {{(pid=125005) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:55:29.551644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ee433857-e8f9-4740-9bdd-8ccd8bd9d87f',volume_size=None,volume_type=None)] {{(pid=125005) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:55:30.249307 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2e837f68-685f-48c0-96f1-61e7c09821ff tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.394793 Jul 18 10:55:30.262264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4c417cfd-6470-4c4b-8236-01fc1771167f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:30.262880 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-4c417cfd-6470-4c4b-8236-01fc1771167f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:30.267152 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 463/955] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:55:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:55:30.322390 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-4c417cfd-6470-4c4b-8236-01fc1771167f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:30.330792 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4c417cfd-6470-4c4b-8236-01fc1771167f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1095 microversion: 2.1 time: 0.072951 Jul 18 10:55:30.331364 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 493/956] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:30 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:31.349358 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3001bc05-fa42-41f2-8a99-47b97d043fab tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:31.349961 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3001bc05-fa42-41f2-8a99-47b97d043fab tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:31.415725 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3001bc05-fa42-41f2-8a99-47b97d043fab tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:31.424270 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3001bc05-fa42-41f2-8a99-47b97d043fab tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1095 microversion: 2.1 time: 0.079876 Jul 18 10:55:31.425130 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 464/957] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:31 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:32.441948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-111d1e60-57d0-4588-aaf9-30eac407c75a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:32.442561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-111d1e60-57d0-4588-aaf9-30eac407c75a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:32.449209 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-111d1e60-57d0-4588-aaf9-30eac407c75a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:32.449664 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-111d1e60-57d0-4588-aaf9-30eac407c75a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:32.451480 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-111d1e60-57d0-4588-aaf9-30eac407c75a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:32.451480 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-111d1e60-57d0-4588-aaf9-30eac407c75a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:32.518432 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-111d1e60-57d0-4588-aaf9-30eac407c75a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:32.526003 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-111d1e60-57d0-4588-aaf9-30eac407c75a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1145 microversion: 2.1 time: 0.088636 Jul 18 10:55:32.526570 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 494/958] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:32 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:33.543498 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-861b1860-d64f-45c3-8f81-95b6d1f44f63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:33.544106 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-861b1860-d64f-45c3-8f81-95b6d1f44f63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:33.551296 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-861b1860-d64f-45c3-8f81-95b6d1f44f63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:33.551763 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-861b1860-d64f-45c3-8f81-95b6d1f44f63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:33.552521 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-861b1860-d64f-45c3-8f81-95b6d1f44f63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:33.552960 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-861b1860-d64f-45c3-8f81-95b6d1f44f63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:33.616587 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-861b1860-d64f-45c3-8f81-95b6d1f44f63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:33.624486 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-861b1860-d64f-45c3-8f81-95b6d1f44f63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1193 microversion: 2.1 time: 0.084985 Jul 18 10:55:33.625088 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 465/959] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:33 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:34.642770 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f6e25544-431a-4309-b859-70b7463a36dc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:34.643435 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f6e25544-431a-4309-b859-70b7463a36dc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:34.650102 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f6e25544-431a-4309-b859-70b7463a36dc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:34.650809 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f6e25544-431a-4309-b859-70b7463a36dc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:34.651588 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f6e25544-431a-4309-b859-70b7463a36dc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:34.652177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f6e25544-431a-4309-b859-70b7463a36dc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:34.736384 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f6e25544-431a-4309-b859-70b7463a36dc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:34.745809 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f6e25544-431a-4309-b859-70b7463a36dc tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1211 microversion: 2.1 time: 0.107133 Jul 18 10:55:34.747127 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 495/960] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:34 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:35.530613 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-ddc9383c-fc35-4854-98c2-1d105af2399d req-0eb63e05-a8dc-45ae-b48e-3643b4d45e48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dab0fce-91d6-4e37-970c-02ba8250d354", "tag": "251fff9b-71a7-49e1-bd58-5b46a671f255"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:55:35.533447 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5195b1c6-8701-4c70-b614-413d6f7ef49b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:35.533947 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-5195b1c6-8701-4c70-b614-413d6f7ef49b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:35.540222 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-ddc9383c-fc35-4854-98c2-1d105af2399d req-0eb63e05-a8dc-45ae-b48e-3643b4d45e48 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:35.540484 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5195b1c6-8701-4c70-b614-413d6f7ef49b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:35.540968 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5195b1c6-8701-4c70-b614-413d6f7ef49b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:35.541172 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-ddc9383c-fc35-4854-98c2-1d105af2399d req-0eb63e05-a8dc-45ae-b48e-3643b4d45e48 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:35.541743 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5195b1c6-8701-4c70-b614-413d6f7ef49b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:35.542179 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5195b1c6-8701-4c70-b614-413d6f7ef49b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:35.557400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-ddc9383c-fc35-4854-98c2-1d105af2399d req-0eb63e05-a8dc-45ae-b48e-3643b4d45e48 service nova] Creating event network-changed:251fff9b-71a7-49e1-bd58-5b46a671f255 for instance 3dab0fce-91d6-4e37-970c-02ba8250d354 on hv-cinder-84949 Jul 18 10:55:35.569492 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-ddc9383c-fc35-4854-98c2-1d105af2399d req-0eb63e05-a8dc-45ae-b48e-3643b4d45e48 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042331 Jul 18 10:55:35.570321 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 466/961] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:35.583093 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-5195b1c6-8701-4c70-b614-413d6f7ef49b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Going to try to terminate instance {{(pid=125007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:55:35.764472 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-1f48278b-ba5a-46f0-b160-acc60da32b04 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:35.765478 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-1f48278b-ba5a-46f0-b160-acc60da32b04 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:35.772497 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1f48278b-ba5a-46f0-b160-acc60da32b04 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:35.773286 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1f48278b-ba5a-46f0-b160-acc60da32b04 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:35.778413 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1f48278b-ba5a-46f0-b160-acc60da32b04 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:35.778413 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1f48278b-ba5a-46f0-b160-acc60da32b04 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:35.945306 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-1f48278b-ba5a-46f0-b160-acc60da32b04 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:35.953678 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-1f48278b-ba5a-46f0-b160-acc60da32b04 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1279 microversion: 2.1 time: 0.193535 Jul 18 10:55:35.954412 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 467/962] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:35 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1279 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:55:36.052335 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5195b1c6-8701-4c70-b614-413d6f7ef49b tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 204 len: 0 microversion: 2.1 time: 0.522887 Jul 18 10:55:36.054139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 496/963] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:55:35 2022] DELETE /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:55:36.063213 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b1f49a21-c431-4751-b46d-74bd8b212956 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:36.064347 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b1f49a21-c431-4751-b46d-74bd8b212956 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:36.070680 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b1f49a21-c431-4751-b46d-74bd8b212956 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:36.071403 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b1f49a21-c431-4751-b46d-74bd8b212956 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:36.072269 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b1f49a21-c431-4751-b46d-74bd8b212956 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:36.072824 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b1f49a21-c431-4751-b46d-74bd8b212956 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:36.214144 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-b1f49a21-c431-4751-b46d-74bd8b212956 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:36.222738 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b1f49a21-c431-4751-b46d-74bd8b212956 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.163792 Jul 18 10:55:36.223530 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 468/964] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:36 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:36.972495 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-844943aa-82a5-455d-a8a2-ee6e65e0debe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:36.973540 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-844943aa-82a5-455d-a8a2-ee6e65e0debe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:36.979785 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-844943aa-82a5-455d-a8a2-ee6e65e0debe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:36.980228 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-844943aa-82a5-455d-a8a2-ee6e65e0debe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:36.985863 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-844943aa-82a5-455d-a8a2-ee6e65e0debe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:36.985863 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-844943aa-82a5-455d-a8a2-ee6e65e0debe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:37.134267 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-844943aa-82a5-455d-a8a2-ee6e65e0debe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:37.142206 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-844943aa-82a5-455d-a8a2-ee6e65e0debe tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1279 microversion: 2.1 time: 0.174271 Jul 18 10:55:37.142918 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 497/965] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:36 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:37.240839 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-34f2c8a4-09b0-4942-9006-3652a78900c7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:37.241475 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-34f2c8a4-09b0-4942-9006-3652a78900c7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:37.248214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-34f2c8a4-09b0-4942-9006-3652a78900c7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:37.248761 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-34f2c8a4-09b0-4942-9006-3652a78900c7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:37.249653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-34f2c8a4-09b0-4942-9006-3652a78900c7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:37.250200 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-34f2c8a4-09b0-4942-9006-3652a78900c7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:37.392427 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-34f2c8a4-09b0-4942-9006-3652a78900c7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:37.400097 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-34f2c8a4-09b0-4942-9006-3652a78900c7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.163624 Jul 18 10:55:37.400699 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 469/966] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:37 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:37.784146 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-734269bd-a851-4a78-ac0f-7619f288d622 req-1efd7eaa-bc69-42d3-9147-006fedd54719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "876868b6-0929-4e64-b86c-274d075180e8", "tag": "024aed1d-8cc5-44ea-a5be-0e2863bf4794"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:55:37.794972 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-734269bd-a851-4a78-ac0f-7619f288d622 req-1efd7eaa-bc69-42d3-9147-006fedd54719 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:37.795619 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-734269bd-a851-4a78-ac0f-7619f288d622 req-1efd7eaa-bc69-42d3-9147-006fedd54719 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:37.827807 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-734269bd-a851-4a78-ac0f-7619f288d622 req-1efd7eaa-bc69-42d3-9147-006fedd54719 service nova] Creating event network-changed:024aed1d-8cc5-44ea-a5be-0e2863bf4794 for instance 876868b6-0929-4e64-b86c-274d075180e8 on hv-cinder-84949 Jul 18 10:55:37.834742 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-734269bd-a851-4a78-ac0f-7619f288d622 req-1efd7eaa-bc69-42d3-9147-006fedd54719 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055104 Jul 18 10:55:37.835348 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 498/967] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:38.159662 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2414e295-4692-4f3a-b55c-adeb75e57d2d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:38.160269 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2414e295-4692-4f3a-b55c-adeb75e57d2d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:38.166296 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2414e295-4692-4f3a-b55c-adeb75e57d2d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:38.166736 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2414e295-4692-4f3a-b55c-adeb75e57d2d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:38.167496 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2414e295-4692-4f3a-b55c-adeb75e57d2d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:38.167928 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2414e295-4692-4f3a-b55c-adeb75e57d2d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:38.304039 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-2414e295-4692-4f3a-b55c-adeb75e57d2d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:38.311599 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2414e295-4692-4f3a-b55c-adeb75e57d2d tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1279 microversion: 2.1 time: 0.156237 Jul 18 10:55:38.312167 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 470/968] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:38 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1279 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:38.419130 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8bd3edec-d0f3-4bc2-a8cc-2a0ccffacafd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:38.419831 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-8bd3edec-d0f3-4bc2-a8cc-2a0ccffacafd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:38.427014 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8bd3edec-d0f3-4bc2-a8cc-2a0ccffacafd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:38.427460 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8bd3edec-d0f3-4bc2-a8cc-2a0ccffacafd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:38.428233 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8bd3edec-d0f3-4bc2-a8cc-2a0ccffacafd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:38.428671 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8bd3edec-d0f3-4bc2-a8cc-2a0ccffacafd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:38.575454 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-8bd3edec-d0f3-4bc2-a8cc-2a0ccffacafd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:38.584672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-8bd3edec-d0f3-4bc2-a8cc-2a0ccffacafd tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.170131 Jul 18 10:55:38.587223 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 499/969] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:38 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:39.340640 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e88abd2e-4be0-4013-8bf8-70a185d9535a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:39.341377 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e88abd2e-4be0-4013-8bf8-70a185d9535a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:39.350685 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e88abd2e-4be0-4013-8bf8-70a185d9535a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:39.351677 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e88abd2e-4be0-4013-8bf8-70a185d9535a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:39.353105 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e88abd2e-4be0-4013-8bf8-70a185d9535a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:39.353587 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e88abd2e-4be0-4013-8bf8-70a185d9535a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:39.473376 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=2 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:39.602788 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d4ca982e-fd7a-4a59-9fcc-1718a6755642 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:39.603660 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d4ca982e-fd7a-4a59-9fcc-1718a6755642 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:39.612068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d4ca982e-fd7a-4a59-9fcc-1718a6755642 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:39.612649 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d4ca982e-fd7a-4a59-9fcc-1718a6755642 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:39.613886 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d4ca982e-fd7a-4a59-9fcc-1718a6755642 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:39.614386 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d4ca982e-fd7a-4a59-9fcc-1718a6755642 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:39.679002 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e88abd2e-4be0-4013-8bf8-70a185d9535a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:39.687223 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e88abd2e-4be0-4013-8bf8-70a185d9535a tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1279 microversion: 2.1 time: 0.351229 Jul 18 10:55:39.698420 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 471/970] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:39 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1279 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:39.906376 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d4ca982e-fd7a-4a59-9fcc-1718a6755642 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:39.923353 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d4ca982e-fd7a-4a59-9fcc-1718a6755642 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1568 microversion: 2.1 time: 0.324579 Jul 18 10:55:39.935927 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 500/971] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:39 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1568 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:55:40.707072 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7428374f-73e0-4df0-a95b-588ebe7fcbec tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:40.707732 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-7428374f-73e0-4df0-a95b-588ebe7fcbec tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:40.714900 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7428374f-73e0-4df0-a95b-588ebe7fcbec tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:40.715331 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7428374f-73e0-4df0-a95b-588ebe7fcbec tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:40.716109 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7428374f-73e0-4df0-a95b-588ebe7fcbec tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:40.716528 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7428374f-73e0-4df0-a95b-588ebe7fcbec tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:40.923451 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7428374f-73e0-4df0-a95b-588ebe7fcbec tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:40.943105 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7428374f-73e0-4df0-a95b-588ebe7fcbec tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.233551 Jul 18 10:55:40.943230 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e1464e7a-40e7-4697-b451-2fe4f0e6a0de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:40.943230 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-e1464e7a-40e7-4697-b451-2fe4f0e6a0de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:40.946489 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=2 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:40.947236 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 472/972] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:40 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:40.950741 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e1464e7a-40e7-4697-b451-2fe4f0e6a0de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:40.951445 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e1464e7a-40e7-4697-b451-2fe4f0e6a0de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:40.952217 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e1464e7a-40e7-4697-b451-2fe4f0e6a0de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:40.952678 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-d24bb061-5124-421a-b8b8-b2294f463bb2 req-4698f7a3-7333-460a-b741-66dfcde8acdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dab0fce-91d6-4e37-970c-02ba8250d354", "name": "network-vif-deleted", "tag": "251fff9b-71a7-49e1-bd58-5b46a671f255"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:55:40.953193 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e1464e7a-40e7-4697-b451-2fe4f0e6a0de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:40.962191 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-d24bb061-5124-421a-b8b8-b2294f463bb2 req-4698f7a3-7333-460a-b741-66dfcde8acdf service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:40.963167 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-d24bb061-5124-421a-b8b8-b2294f463bb2 req-4698f7a3-7333-460a-b741-66dfcde8acdf service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:40.977166 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-d24bb061-5124-421a-b8b8-b2294f463bb2 req-4698f7a3-7333-460a-b741-66dfcde8acdf service nova] Creating event network-vif-deleted:251fff9b-71a7-49e1-bd58-5b46a671f255 for instance 3dab0fce-91d6-4e37-970c-02ba8250d354 on hv-cinder-84949 Jul 18 10:55:40.982240 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-d24bb061-5124-421a-b8b8-b2294f463bb2 req-4698f7a3-7333-460a-b741-66dfcde8acdf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033749 Jul 18 10:55:40.983081 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 473/973] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:41.027256 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e1464e7a-40e7-4697-b451-2fe4f0e6a0de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:41.036147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e1464e7a-40e7-4697-b451-2fe4f0e6a0de tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1382 microversion: 2.1 time: 0.099266 Jul 18 10:55:41.036716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 501/974] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:40 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1382 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:55:41.953617 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-1922e22d-b9c3-497e-8494-1fed5a9c8363 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:41.955009 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-1922e22d-b9c3-497e-8494-1fed5a9c8363 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:41.956967 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=8 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:41.962179 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1922e22d-b9c3-497e-8494-1fed5a9c8363 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:41.962875 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1922e22d-b9c3-497e-8494-1fed5a9c8363 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:41.963730 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1922e22d-b9c3-497e-8494-1fed5a9c8363 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:41.964052 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1922e22d-b9c3-497e-8494-1fed5a9c8363 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:42.057643 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-934e188d-3afb-46c3-80e3-629f1438fb17 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:42.058986 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-934e188d-3afb-46c3-80e3-629f1438fb17 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:42.066603 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-934e188d-3afb-46c3-80e3-629f1438fb17 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:42.067485 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-934e188d-3afb-46c3-80e3-629f1438fb17 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:42.068467 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-934e188d-3afb-46c3-80e3-629f1438fb17 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:42.068927 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-934e188d-3afb-46c3-80e3-629f1438fb17 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:42.126948 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-1922e22d-b9c3-497e-8494-1fed5a9c8363 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:42.130483 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-1922e22d-b9c3-497e-8494-1fed5a9c8363 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.181231 Jul 18 10:55:42.131054 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 474/975] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:41 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:42.143073 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-934e188d-3afb-46c3-80e3-629f1438fb17 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:42.150779 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-934e188d-3afb-46c3-80e3-629f1438fb17 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1219 microversion: 2.1 time: 0.100255 Jul 18 10:55:42.151352 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 502/976] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:42 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:55:43.148799 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d20a5dd7-98e1-499d-ac0b-ce59db8cd432 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:43.149686 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d20a5dd7-98e1-499d-ac0b-ce59db8cd432 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:43.156526 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d20a5dd7-98e1-499d-ac0b-ce59db8cd432 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:43.157818 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d20a5dd7-98e1-499d-ac0b-ce59db8cd432 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:43.158836 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d20a5dd7-98e1-499d-ac0b-ce59db8cd432 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:43.159699 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d20a5dd7-98e1-499d-ac0b-ce59db8cd432 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:43.167915 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0e05cc36-8b5b-484f-9a07-b3740a8620be tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:43.170848 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-0e05cc36-8b5b-484f-9a07-b3740a8620be tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:43.178306 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0e05cc36-8b5b-484f-9a07-b3740a8620be tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:43.178760 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0e05cc36-8b5b-484f-9a07-b3740a8620be tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:43.179715 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0e05cc36-8b5b-484f-9a07-b3740a8620be tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:43.180492 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0e05cc36-8b5b-484f-9a07-b3740a8620be tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:43.215395 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0e05cc36-8b5b-484f-9a07-b3740a8620be tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:43.216200 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0e05cc36-8b5b-484f-9a07-b3740a8620be tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:43.216851 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-0e05cc36-8b5b-484f-9a07-b3740a8620be tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lazy-loading 'fault' on Instance uuid 3dab0fce-91d6-4e37-970c-02ba8250d354 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:55:43.267832 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-0e05cc36-8b5b-484f-9a07-b3740a8620be tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:43.278262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-0e05cc36-8b5b-484f-9a07-b3740a8620be tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1224 microversion: 2.1 time: 0.114186 Jul 18 10:55:43.279559 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 503/977] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:43 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:55:43.333174 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-d20a5dd7-98e1-499d-ac0b-ce59db8cd432 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:43.341833 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d20a5dd7-98e1-499d-ac0b-ce59db8cd432 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.197391 Jul 18 10:55:43.342476 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 475/978] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:43 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:44.296007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ce484fe6-a334-47be-98c9-b37b1d80c64d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:44.296579 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ce484fe6-a334-47be-98c9-b37b1d80c64d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:44.304150 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ce484fe6-a334-47be-98c9-b37b1d80c64d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:44.304596 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ce484fe6-a334-47be-98c9-b37b1d80c64d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:44.305607 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ce484fe6-a334-47be-98c9-b37b1d80c64d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:44.306045 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ce484fe6-a334-47be-98c9-b37b1d80c64d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:44.341766 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ce484fe6-a334-47be-98c9-b37b1d80c64d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:44.342219 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ce484fe6-a334-47be-98c9-b37b1d80c64d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:44.342671 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-ce484fe6-a334-47be-98c9-b37b1d80c64d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lazy-loading 'fault' on Instance uuid 3dab0fce-91d6-4e37-970c-02ba8250d354 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:55:44.360920 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2273fe3a-df05-40d3-b854-7f83dd726bc6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:44.362309 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2273fe3a-df05-40d3-b854-7f83dd726bc6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:44.377672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2273fe3a-df05-40d3-b854-7f83dd726bc6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:44.377672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2273fe3a-df05-40d3-b854-7f83dd726bc6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:44.377672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2273fe3a-df05-40d3-b854-7f83dd726bc6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:44.377672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2273fe3a-df05-40d3-b854-7f83dd726bc6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:44.402741 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ce484fe6-a334-47be-98c9-b37b1d80c64d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '926d4c4971f1425b98aa5828f802fb21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f36b12884cc423988d28fdcbdb1d8f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:44.416463 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ce484fe6-a334-47be-98c9-b37b1d80c64d tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 200 len: 1224 microversion: 2.1 time: 0.124686 Jul 18 10:55:44.429150 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 504/979] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:44 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 1224 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:44.533707 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-2273fe3a-df05-40d3-b854-7f83dd726bc6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:44.541552 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2273fe3a-df05-40d3-b854-7f83dd726bc6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.185727 Jul 18 10:55:44.542102 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 476/980] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:44 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:55:45.439617 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-07172591-4673-4e25-b392-d78ed91064b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:45.440817 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-07172591-4673-4e25-b392-d78ed91064b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] [instance: 3dab0fce-91d6-4e37-970c-02ba8250d354] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:45.448969 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-07172591-4673-4e25-b392-d78ed91064b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:45.449410 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-07172591-4673-4e25-b392-d78ed91064b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:45.450209 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-07172591-4673-4e25-b392-d78ed91064b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:45.450643 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-07172591-4673-4e25-b392-d78ed91064b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:45.466159 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-07172591-4673-4e25-b392-d78ed91064b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] HTTP exception thrown: Instance 3dab0fce-91d6-4e37-970c-02ba8250d354 could not be found. Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-07172591-4673-4e25-b392-d78ed91064b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Request method failure captured: Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 HTTP/1.1 Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1TraoTT35XYpZn2aROzYqOjMbkdQtMOPcigkRM0vo_d5VTyeekVeXfxhcev5LWFKLfW9ZueFPn5tTBkywtVVBticLoH9_tvuR7cSK9T0di7NSOuWhpyJSy8orNIQxH9UxzUnDmIz4p8a0jUI8Egls2PYMc7eDwjbqgCONX0R7OwjE3I Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 7f36b12884cc423988d28fdcbdb1d8f9 Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-TestShelveInstance-841467409 Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:55:45.467861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:55:45.470239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7f36b12884cc423988d28fdcbdb1d8f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7f36b12884cc423988d28fdcbdb1d8f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7f36b12884cc423988d28fdcbdb1d8f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7f36b12884cc423988d28fdcbdb1d8f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:55:45.470239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-TestShelveInstance-841467409 Jul 18 10:55:45.470239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 7f36b12884cc423988d28fdcbdb1d8f9 Jul 18 10:55:45.470239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-TestShelveInstance-841467409 Jul 18 10:55:45.470239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-TestShelveInstance-841467409-project Jul 18 10:55:45.470239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:55:45.470239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:55:45.470239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 926d4c4971f1425b98aa5828f802fb21 Jul 18 10:55:45.470239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-TestShelveInstance-841467409-project Jul 18 10:55:45.470239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:55:45.470239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 3dab0fce-91d6-4e37-970c-02ba8250d354 could not be found. Jul 18 10:55:45.470239 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '3dab0fce-91d6-4e37-970c-02ba8250d354'} Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dab0fce-91d6-4e37-970c-02ba8250d354 could not be found. Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:55:45.471543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dab0fce-91d6-4e37-970c-02ba8250d354 could not be found. Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dab0fce-91d6-4e37-970c-02ba8250d354 could not be found. Jul 18 10:55:45.473258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:55:45.474995 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-07172591-4673-4e25-b392-d78ed91064b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Returning 404 to user: Instance 3dab0fce-91d6-4e37-970c-02ba8250d354 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:55:45.474995 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-07172591-4673-4e25-b392-d78ed91064b9 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354" status: 404 len: 111 microversion: 2.1 time: 0.034754 Jul 18 10:55:45.474995 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 505/981] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:45 2022] GET /compute/v2.1/servers/3dab0fce-91d6-4e37-970c-02ba8250d354 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:55:45.559612 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-69c17dc4-fb1f-47f0-9b0b-7abc25a81f40 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:45.560761 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-69c17dc4-fb1f-47f0-9b0b-7abc25a81f40 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:45.568700 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-69c17dc4-fb1f-47f0-9b0b-7abc25a81f40 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:45.569414 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-69c17dc4-fb1f-47f0-9b0b-7abc25a81f40 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:45.570391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-69c17dc4-fb1f-47f0-9b0b-7abc25a81f40 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:45.571057 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-69c17dc4-fb1f-47f0-9b0b-7abc25a81f40 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:45.763085 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-69c17dc4-fb1f-47f0-9b0b-7abc25a81f40 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:45.771274 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-69c17dc4-fb1f-47f0-9b0b-7abc25a81f40 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.215788 Jul 18 10:55:45.772155 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 477/982] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:45 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:45.832343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-cec4fa5e-f846-4f68-8922-21a794075dc7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] Calling method '.version_select at 0x7f6364b87700>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:46.025674 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-cec4fa5e-f846-4f68-8922-21a794075dc7 tempest-TestShelveInstance-841467409 tempest-TestShelveInstance-841467409-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1160011770" status: 202 len: 0 microversion: 2.1 time: 0.198476 Jul 18 10:55:46.026983 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 506/983] 10.222.0.49 () {58 vars in 1253 bytes} [Mon Jul 18 10:55:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1160011770 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:55:46.788832 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-354da70f-01ff-468a-a95b-eeaa153dadd4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:46.789505 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-354da70f-01ff-468a-a95b-eeaa153dadd4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:46.796565 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-354da70f-01ff-468a-a95b-eeaa153dadd4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:46.803353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-354da70f-01ff-468a-a95b-eeaa153dadd4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:46.803353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-354da70f-01ff-468a-a95b-eeaa153dadd4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:46.803353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-354da70f-01ff-468a-a95b-eeaa153dadd4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:46.960266 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-354da70f-01ff-468a-a95b-eeaa153dadd4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:46.969493 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-354da70f-01ff-468a-a95b-eeaa153dadd4 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.184550 Jul 18 10:55:46.980579 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 478/984] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:46 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:47.987802 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2fc4bc18-7cde-4f25-8978-68fcb7e9db25 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:47.988503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2fc4bc18-7cde-4f25-8978-68fcb7e9db25 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:48.005106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2fc4bc18-7cde-4f25-8978-68fcb7e9db25 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:48.017559 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2fc4bc18-7cde-4f25-8978-68fcb7e9db25 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:48.017559 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2fc4bc18-7cde-4f25-8978-68fcb7e9db25 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:48.017559 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2fc4bc18-7cde-4f25-8978-68fcb7e9db25 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:48.200202 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-2fc4bc18-7cde-4f25-8978-68fcb7e9db25 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:48.209611 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2fc4bc18-7cde-4f25-8978-68fcb7e9db25 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.225975 Jul 18 10:55:48.220993 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 507/985] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:47 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:49.228355 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-91623ecd-d9bb-49c6-8826-bbb07545f818 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:49.229005 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-91623ecd-d9bb-49c6-8826-bbb07545f818 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:49.236951 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-91623ecd-d9bb-49c6-8826-bbb07545f818 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:49.237409 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-91623ecd-d9bb-49c6-8826-bbb07545f818 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:49.238407 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-91623ecd-d9bb-49c6-8826-bbb07545f818 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:49.239221 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-91623ecd-d9bb-49c6-8826-bbb07545f818 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:49.393693 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-91623ecd-d9bb-49c6-8826-bbb07545f818 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:49.401336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-91623ecd-d9bb-49c6-8826-bbb07545f818 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.176832 Jul 18 10:55:49.401916 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 479/986] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:49 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:50.419050 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9e2a1fd8-d8fb-47e2-8754-9ed1a540ed5b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:50.419663 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9e2a1fd8-d8fb-47e2-8754-9ed1a540ed5b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:50.432334 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e2a1fd8-d8fb-47e2-8754-9ed1a540ed5b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:50.432955 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e2a1fd8-d8fb-47e2-8754-9ed1a540ed5b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:50.433750 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e2a1fd8-d8fb-47e2-8754-9ed1a540ed5b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:50.434489 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e2a1fd8-d8fb-47e2-8754-9ed1a540ed5b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:50.589995 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9e2a1fd8-d8fb-47e2-8754-9ed1a540ed5b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:50.602065 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9e2a1fd8-d8fb-47e2-8754-9ed1a540ed5b tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.186928 Jul 18 10:55:50.602680 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 508/987] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:50 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:51.620619 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7c28bd6c-d1f3-4a6b-8031-79e6257fd677 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:51.621325 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-7c28bd6c-d1f3-4a6b-8031-79e6257fd677 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:51.627763 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7c28bd6c-d1f3-4a6b-8031-79e6257fd677 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:51.628213 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7c28bd6c-d1f3-4a6b-8031-79e6257fd677 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:51.629089 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7c28bd6c-d1f3-4a6b-8031-79e6257fd677 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:51.629580 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7c28bd6c-d1f3-4a6b-8031-79e6257fd677 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:51.785750 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7c28bd6c-d1f3-4a6b-8031-79e6257fd677 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:51.799178 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7c28bd6c-d1f3-4a6b-8031-79e6257fd677 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.181752 Jul 18 10:55:51.811206 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 480/988] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:51 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:52.817402 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-697c48b2-2650-4ffe-a580-0d6b277e4e4c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:52.818629 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-697c48b2-2650-4ffe-a580-0d6b277e4e4c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:52.827258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-697c48b2-2650-4ffe-a580-0d6b277e4e4c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:52.828382 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-697c48b2-2650-4ffe-a580-0d6b277e4e4c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:52.830185 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-697c48b2-2650-4ffe-a580-0d6b277e4e4c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:52.830884 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-697c48b2-2650-4ffe-a580-0d6b277e4e4c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:53.023894 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-697c48b2-2650-4ffe-a580-0d6b277e4e4c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:53.033177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-697c48b2-2650-4ffe-a580-0d6b277e4e4c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.220433 Jul 18 10:55:53.043365 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 509/989] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:52 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:53.330463 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-0bc7f151-c257-487b-a304-5f45c76ce3ae req-7632d4e5-4c3e-4b49-a331-5bf29a057634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876868b6-0929-4e64-b86c-274d075180e8", "name": "network-vif-plugged", "status": "completed", "tag": "024aed1d-8cc5-44ea-a5be-0e2863bf4794"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:55:53.340622 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-0bc7f151-c257-487b-a304-5f45c76ce3ae req-7632d4e5-4c3e-4b49-a331-5bf29a057634 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:53.341246 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-0bc7f151-c257-487b-a304-5f45c76ce3ae req-7632d4e5-4c3e-4b49-a331-5bf29a057634 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:53.354154 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-0bc7f151-c257-487b-a304-5f45c76ce3ae req-7632d4e5-4c3e-4b49-a331-5bf29a057634 service nova] Creating event network-vif-plugged:024aed1d-8cc5-44ea-a5be-0e2863bf4794 for instance 876868b6-0929-4e64-b86c-274d075180e8 on hv-cinder-84949 Jul 18 10:55:53.361269 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-0bc7f151-c257-487b-a304-5f45c76ce3ae req-7632d4e5-4c3e-4b49-a331-5bf29a057634 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033954 Jul 18 10:55:53.362232 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 481/990] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:54.050682 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-9e5af7d8-9efa-4f77-80ba-8a6041b2814f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:54.051357 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-9e5af7d8-9efa-4f77-80ba-8a6041b2814f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:54.053953 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:54.058902 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e5af7d8-9efa-4f77-80ba-8a6041b2814f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:54.059556 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e5af7d8-9efa-4f77-80ba-8a6041b2814f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:54.060349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e5af7d8-9efa-4f77-80ba-8a6041b2814f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:54.061387 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-9e5af7d8-9efa-4f77-80ba-8a6041b2814f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:54.071823 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:54.290362 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-9e5af7d8-9efa-4f77-80ba-8a6041b2814f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:54.299366 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-9e5af7d8-9efa-4f77-80ba-8a6041b2814f tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.252879 Jul 18 10:55:54.300261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 510/991] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:54 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:55.319177 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a5df9348-94f9-4856-ae9a-5a2b620cdbee tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:55.319883 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a5df9348-94f9-4856-ae9a-5a2b620cdbee tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:55.326730 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a5df9348-94f9-4856-ae9a-5a2b620cdbee tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:55.327173 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a5df9348-94f9-4856-ae9a-5a2b620cdbee tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:55.327961 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a5df9348-94f9-4856-ae9a-5a2b620cdbee tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:55.329105 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a5df9348-94f9-4856-ae9a-5a2b620cdbee tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:55.474816 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a5df9348-94f9-4856-ae9a-5a2b620cdbee tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:55.483536 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a5df9348-94f9-4856-ae9a-5a2b620cdbee tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.169168 Jul 18 10:55:55.485498 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 482/992] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:55 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:56.502100 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-1d7885a2-6bc7-42fb-8288-b4290c8ee335 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:56.502636 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-1d7885a2-6bc7-42fb-8288-b4290c8ee335 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:56.511090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1d7885a2-6bc7-42fb-8288-b4290c8ee335 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:56.511540 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1d7885a2-6bc7-42fb-8288-b4290c8ee335 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:56.512363 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1d7885a2-6bc7-42fb-8288-b4290c8ee335 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:56.512820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1d7885a2-6bc7-42fb-8288-b4290c8ee335 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:56.680542 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-1d7885a2-6bc7-42fb-8288-b4290c8ee335 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:56.690074 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-1d7885a2-6bc7-42fb-8288-b4290c8ee335 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.192514 Jul 18 10:55:56.690683 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 511/993] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:56 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:57.709685 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c00740d2-5242-4b53-bc86-217b43685ca8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:57.710368 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c00740d2-5242-4b53-bc86-217b43685ca8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:57.713701 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:57.718608 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c00740d2-5242-4b53-bc86-217b43685ca8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:57.719793 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c00740d2-5242-4b53-bc86-217b43685ca8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:57.721273 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c00740d2-5242-4b53-bc86-217b43685ca8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:57.722020 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c00740d2-5242-4b53-bc86-217b43685ca8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:57.725948 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=99 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:57.882357 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c00740d2-5242-4b53-bc86-217b43685ca8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:57.890772 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c00740d2-5242-4b53-bc86-217b43685ca8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.185501 Jul 18 10:55:57.891350 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 483/994] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:57 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:58.910193 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f61b10aa-50d8-41ba-8152-abb83d79a43e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:58.910906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f61b10aa-50d8-41ba-8152-abb83d79a43e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:58.918214 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f61b10aa-50d8-41ba-8152-abb83d79a43e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:58.918759 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f61b10aa-50d8-41ba-8152-abb83d79a43e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:58.919913 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f61b10aa-50d8-41ba-8152-abb83d79a43e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:58.920646 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f61b10aa-50d8-41ba-8152-abb83d79a43e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:59.075892 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f61b10aa-50d8-41ba-8152-abb83d79a43e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:59.085960 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f61b10aa-50d8-41ba-8152-abb83d79a43e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1267 microversion: 2.1 time: 0.181200 Jul 18 10:55:59.086664 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 512/995] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:58 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:00.110161 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bd1f116c-ef0d-4471-b376-243889195d8e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:00.110976 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-bd1f116c-ef0d-4471-b376-243889195d8e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:00.117366 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bd1f116c-ef0d-4471-b376-243889195d8e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:00.117821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bd1f116c-ef0d-4471-b376-243889195d8e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:00.118651 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bd1f116c-ef0d-4471-b376-243889195d8e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:00.119089 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bd1f116c-ef0d-4471-b376-243889195d8e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:00.323149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bd1f116c-ef0d-4471-b376-243889195d8e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:00.331829 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-bd1f116c-ef0d-4471-b376-243889195d8e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1454 microversion: 2.1 time: 0.226889 Jul 18 10:56:00.332408 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 484/996] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:00 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1454 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:00.352346 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-59a83a22-86b1-4bc7-9149-e8a6bf828986 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:00.353087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-59a83a22-86b1-4bc7-9149-e8a6bf828986 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:00.360106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-59a83a22-86b1-4bc7-9149-e8a6bf828986 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:00.360564 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-59a83a22-86b1-4bc7-9149-e8a6bf828986 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:00.361381 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-59a83a22-86b1-4bc7-9149-e8a6bf828986 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:00.361821 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-59a83a22-86b1-4bc7-9149-e8a6bf828986 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:00.551768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-59a83a22-86b1-4bc7-9149-e8a6bf828986 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:00.560049 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-59a83a22-86b1-4bc7-9149-e8a6bf828986 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1454 microversion: 2.1 time: 0.212290 Jul 18 10:56:00.569404 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 513/997] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:00 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1454 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:03.547788 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-3131ef0c-d8ac-471e-8a32-47ff97e56d3c req-fa9a5f8c-9e83-44c5-bf29-8d2ff6517132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "876868b6-0929-4e64-b86c-274d075180e8", "tag": "024aed1d-8cc5-44ea-a5be-0e2863bf4794"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:56:03.557115 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-3131ef0c-d8ac-471e-8a32-47ff97e56d3c req-fa9a5f8c-9e83-44c5-bf29-8d2ff6517132 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:03.557557 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-3131ef0c-d8ac-471e-8a32-47ff97e56d3c req-fa9a5f8c-9e83-44c5-bf29-8d2ff6517132 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:03.570288 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-3131ef0c-d8ac-471e-8a32-47ff97e56d3c req-fa9a5f8c-9e83-44c5-bf29-8d2ff6517132 service nova] Creating event network-changed:024aed1d-8cc5-44ea-a5be-0e2863bf4794 for instance 876868b6-0929-4e64-b86c-274d075180e8 on hv-cinder-84949 Jul 18 10:56:03.575485 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-3131ef0c-d8ac-471e-8a32-47ff97e56d3c req-fa9a5f8c-9e83-44c5-bf29-8d2ff6517132 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032043 Jul 18 10:56:03.576237 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 485/998] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:56:41.995661 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1537531078", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "networks": [{"uuid": "4d3b5885-0cea-4000-b7c7-cf07ce205b79"}]}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:56:42.008748 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=7 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:56:42.009856 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=23 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:56:42.065537 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.network.neutron [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] validate_networks() for [('4d3b5885-0cea-4000-b7c7-cf07ce205b79', None, None, None, None, None)] {{(pid=125007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:56:42.529536 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Flavor limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:56:42.530361 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Image limits 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:56:42.531033 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Flavor pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:56:42.531698 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Image pref 0:0:0 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:56:42.532313 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.virt.hardware [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:56:42.543286 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:42.543728 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:42.544526 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:42.544990 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:42.572655 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Getting quotas for project bf3f09bf74324f7ca7268feb67c046f8. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:56:42.578527 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Getting quotas for user d612283280884f119b50cceae973a6ec and project bf3f09bf74324f7ca7268feb67c046f8. Resources: {'instances', 'ram', 'cores'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:56:42.596511 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Going to run 1 instances... {{(pid=125007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:56:42.600265 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:56:42.772976 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-85b0ce7e-0637-42ae-812d-6ea19ae867c0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783966 Jul 18 10:56:42.774141 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 514/999] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:56:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:56:42.785240 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=5 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:56:42.787123 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=13 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:56:42.792870 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-97803018-ce07-4692-b9e0-495109f93e40 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:42.794037 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-97803018-ce07-4692-b9e0-495109f93e40 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:42.891452 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-97803018-ce07-4692-b9e0-495109f93e40 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:42.900443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-97803018-ce07-4692-b9e0-495109f93e40 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1219 microversion: 2.1 time: 0.117186 Jul 18 10:56:42.901652 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 486/1000] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:42 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:56:43.923150 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-55e6e8b9-b2a7-45e3-9248-9240a76cb9b8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:43.923781 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-55e6e8b9-b2a7-45e3-9248-9240a76cb9b8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:43.987244 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-55e6e8b9-b2a7-45e3-9248-9240a76cb9b8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:43.995797 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-55e6e8b9-b2a7-45e3-9248-9240a76cb9b8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1219 microversion: 2.1 time: 0.078116 Jul 18 10:56:43.996545 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 515/1001] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:43 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:45.018948 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8adc35c0-a1a7-4cdd-83a3-3342d2408e50 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:45.020009 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8adc35c0-a1a7-4cdd-83a3-3342d2408e50 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:45.035417 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8adc35c0-a1a7-4cdd-83a3-3342d2408e50 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:45.036185 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8adc35c0-a1a7-4cdd-83a3-3342d2408e50 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:45.037555 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8adc35c0-a1a7-4cdd-83a3-3342d2408e50 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:45.038422 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8adc35c0-a1a7-4cdd-83a3-3342d2408e50 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:45.108247 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8adc35c0-a1a7-4cdd-83a3-3342d2408e50 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:45.118060 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8adc35c0-a1a7-4cdd-83a3-3342d2408e50 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1215 microversion: 2.1 time: 0.108047 Jul 18 10:56:45.119307 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 487/1002] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:45 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:46.138381 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d6850820-185f-4447-a2e6-8875c1a4b7d1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:46.139720 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d6850820-185f-4447-a2e6-8875c1a4b7d1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:46.149356 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6850820-185f-4447-a2e6-8875c1a4b7d1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:46.154003 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6850820-185f-4447-a2e6-8875c1a4b7d1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:46.154003 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6850820-185f-4447-a2e6-8875c1a4b7d1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:46.154003 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d6850820-185f-4447-a2e6-8875c1a4b7d1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:46.238835 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d6850820-185f-4447-a2e6-8875c1a4b7d1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:46.246985 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d6850820-185f-4447-a2e6-8875c1a4b7d1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1289 microversion: 2.1 time: 0.114487 Jul 18 10:56:46.247579 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 516/1003] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:46 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1289 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:56:47.268653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b2280019-2b0a-4788-b501-8d0704937413 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:47.269693 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b2280019-2b0a-4788-b501-8d0704937413 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:47.282485 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b2280019-2b0a-4788-b501-8d0704937413 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:47.283202 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b2280019-2b0a-4788-b501-8d0704937413 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:47.285183 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b2280019-2b0a-4788-b501-8d0704937413 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:47.286063 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b2280019-2b0a-4788-b501-8d0704937413 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:47.461605 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-b2280019-2b0a-4788-b501-8d0704937413 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:47.470690 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b2280019-2b0a-4788-b501-8d0704937413 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1319 microversion: 2.1 time: 0.209707 Jul 18 10:56:47.472109 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 488/1004] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:47 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:48.132046 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-7b4093a0-def5-4c1b-813f-0a3566049851 req-42106630-7251-4132-b1d4-e8c607383dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64981f66-63e8-4a97-8692-87aa75b7ac79", "tag": "10521465-8839-40ca-b38b-0742f4477643"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:56:48.143411 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-7b4093a0-def5-4c1b-813f-0a3566049851 req-42106630-7251-4132-b1d4-e8c607383dbc service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:48.145832 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-7b4093a0-def5-4c1b-813f-0a3566049851 req-42106630-7251-4132-b1d4-e8c607383dbc service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:48.157862 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-7b4093a0-def5-4c1b-813f-0a3566049851 req-42106630-7251-4132-b1d4-e8c607383dbc service nova] Creating event network-changed:10521465-8839-40ca-b38b-0742f4477643 for instance 64981f66-63e8-4a97-8692-87aa75b7ac79 on hv-cinder-84949 Jul 18 10:56:48.162809 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-7b4093a0-def5-4c1b-813f-0a3566049851 req-42106630-7251-4132-b1d4-e8c607383dbc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034832 Jul 18 10:56:48.163790 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 517/1005] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:56:48.490124 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-24ca53b7-fa9b-4c95-9bbd-816cb2ef037c tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:48.490995 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-24ca53b7-fa9b-4c95-9bbd-816cb2ef037c tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:48.499430 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-24ca53b7-fa9b-4c95-9bbd-816cb2ef037c tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:48.500127 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-24ca53b7-fa9b-4c95-9bbd-816cb2ef037c tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:48.500908 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-24ca53b7-fa9b-4c95-9bbd-816cb2ef037c tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:48.501573 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-24ca53b7-fa9b-4c95-9bbd-816cb2ef037c tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:48.691484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-24ca53b7-fa9b-4c95-9bbd-816cb2ef037c tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:48.701158 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-24ca53b7-fa9b-4c95-9bbd-816cb2ef037c tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1319 microversion: 2.1 time: 0.214856 Jul 18 10:56:48.702476 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 489/1006] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:48 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:56:49.720651 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-7cff99c0-3eea-4d0f-9c61-8e19870556ce tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:49.721614 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-7cff99c0-3eea-4d0f-9c61-8e19870556ce tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:49.728122 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7cff99c0-3eea-4d0f-9c61-8e19870556ce tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:49.728561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7cff99c0-3eea-4d0f-9c61-8e19870556ce tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:49.729367 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7cff99c0-3eea-4d0f-9c61-8e19870556ce tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:49.729790 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7cff99c0-3eea-4d0f-9c61-8e19870556ce tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:49.876494 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7cff99c0-3eea-4d0f-9c61-8e19870556ce tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:49.884436 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-7cff99c0-3eea-4d0f-9c61-8e19870556ce tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1319 microversion: 2.1 time: 0.168960 Jul 18 10:56:49.886386 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 518/1007] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:49 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:50.903326 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e6013043-edae-4ed6-ab11-bfccc421f6f9 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:50.905271 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e6013043-edae-4ed6-ab11-bfccc421f6f9 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:50.915651 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e6013043-edae-4ed6-ab11-bfccc421f6f9 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:50.915651 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e6013043-edae-4ed6-ab11-bfccc421f6f9 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:50.915651 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e6013043-edae-4ed6-ab11-bfccc421f6f9 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:50.915651 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e6013043-edae-4ed6-ab11-bfccc421f6f9 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:51.052734 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e6013043-edae-4ed6-ab11-bfccc421f6f9 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:51.061296 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e6013043-edae-4ed6-ab11-bfccc421f6f9 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1319 microversion: 2.1 time: 0.162668 Jul 18 10:56:51.061886 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 490/1008] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:50 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:52.078934 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6330c19a-abbd-450b-8f07-ca86e39c67c2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:52.085462 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6330c19a-abbd-450b-8f07-ca86e39c67c2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:52.086942 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6330c19a-abbd-450b-8f07-ca86e39c67c2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:52.087389 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6330c19a-abbd-450b-8f07-ca86e39c67c2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:52.088159 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6330c19a-abbd-450b-8f07-ca86e39c67c2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:52.088595 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6330c19a-abbd-450b-8f07-ca86e39c67c2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:52.254719 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-6330c19a-abbd-450b-8f07-ca86e39c67c2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:52.264466 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6330c19a-abbd-450b-8f07-ca86e39c67c2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1319 microversion: 2.1 time: 0.189216 Jul 18 10:56:52.268008 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 519/1009] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:52 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:52.285034 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1014842425", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452"}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:56:52.340711 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.network.neutron [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] validate_networks() for None {{(pid=125005) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:56:52.644546 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Flavor limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:56:52.645001 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Image limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:56:52.652135 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Flavor pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:56:52.652135 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Image pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:56:52.652135 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:56:52.656529 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:52.657023 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:52.657814 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:52.658240 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:52.676408 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Getting quotas for project 6ccc8499e2e24dfa8bd8eb8ea1978ba7. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:56:52.680433 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Getting quotas for user bc605fb8be754d14b21de88330efe013 and project 6ccc8499e2e24dfa8bd8eb8ea1978ba7. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:56:52.693054 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Going to run 1 instances... {{(pid=125005) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:56:52.695376 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125005) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:56:52.941271 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-368279c0-1e36-41ed-998c-eb60bc389ea4 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660133 Jul 18 10:56:52.942287 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 491/1010] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:56:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:56:52.958750 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-dd6d5fd2-1b56-4d0b-b655-14bcde96a121 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:52.959521 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-dd6d5fd2-1b56-4d0b-b655-14bcde96a121 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:52.974733 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=2 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:56:53.032270 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-dd6d5fd2-1b56-4d0b-b655-14bcde96a121 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:53.039315 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-dd6d5fd2-1b56-4d0b-b655-14bcde96a121 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1215 microversion: 2.1 time: 0.086896 Jul 18 10:56:53.039937 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 520/1011] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:52 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:53.283870 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f6c34a1f-4207-4994-a9bc-85e3eccb4726 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:53.284887 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f6c34a1f-4207-4994-a9bc-85e3eccb4726 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:53.292028 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f6c34a1f-4207-4994-a9bc-85e3eccb4726 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:53.300374 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f6c34a1f-4207-4994-a9bc-85e3eccb4726 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:53.300374 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f6c34a1f-4207-4994-a9bc-85e3eccb4726 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:53.300374 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f6c34a1f-4207-4994-a9bc-85e3eccb4726 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:53.432673 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f6c34a1f-4207-4994-a9bc-85e3eccb4726 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:53.441046 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f6c34a1f-4207-4994-a9bc-85e3eccb4726 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1319 microversion: 2.1 time: 0.161608 Jul 18 10:56:53.441618 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 492/1012] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:53 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:56:54.057104 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-1d85633f-3459-4d6b-bd25-55fb1aaaff55 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:54.057746 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-1d85633f-3459-4d6b-bd25-55fb1aaaff55 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:54.116473 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-1d85633f-3459-4d6b-bd25-55fb1aaaff55 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:54.124721 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-1d85633f-3459-4d6b-bd25-55fb1aaaff55 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1215 microversion: 2.1 time: 0.071169 Jul 18 10:56:54.125679 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 521/1013] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:54 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:54.458270 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e467f6ef-7051-4327-8b18-786211c3cae0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:54.458911 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e467f6ef-7051-4327-8b18-786211c3cae0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:54.465985 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e467f6ef-7051-4327-8b18-786211c3cae0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:54.466427 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e467f6ef-7051-4327-8b18-786211c3cae0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:54.467260 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e467f6ef-7051-4327-8b18-786211c3cae0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:54.467701 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e467f6ef-7051-4327-8b18-786211c3cae0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:54.638050 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e467f6ef-7051-4327-8b18-786211c3cae0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:54.646872 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e467f6ef-7051-4327-8b18-786211c3cae0 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1319 microversion: 2.1 time: 0.192153 Jul 18 10:56:54.647558 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 493/1014] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:54 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:56:54.837685 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-88504e93-afa0-4b84-b30b-2b7d31ca77fd req-7cba513b-486d-47e4-974e-a2b27b5a4d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64981f66-63e8-4a97-8692-87aa75b7ac79", "name": "network-vif-plugged", "status": "completed", "tag": "10521465-8839-40ca-b38b-0742f4477643"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:56:54.847216 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-88504e93-afa0-4b84-b30b-2b7d31ca77fd req-7cba513b-486d-47e4-974e-a2b27b5a4d6e service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:54.847743 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-88504e93-afa0-4b84-b30b-2b7d31ca77fd req-7cba513b-486d-47e4-974e-a2b27b5a4d6e service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:54.860689 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-88504e93-afa0-4b84-b30b-2b7d31ca77fd req-7cba513b-486d-47e4-974e-a2b27b5a4d6e service nova] Creating event network-vif-plugged:10521465-8839-40ca-b38b-0742f4477643 for instance 64981f66-63e8-4a97-8692-87aa75b7ac79 on hv-cinder-84949 Jul 18 10:56:54.866001 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-88504e93-afa0-4b84-b30b-2b7d31ca77fd req-7cba513b-486d-47e4-974e-a2b27b5a4d6e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032587 Jul 18 10:56:54.866634 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 522/1015] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:56:55.149771 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-52455930-8224-4ad3-b48e-200346ca4f26 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:55.149771 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-52455930-8224-4ad3-b48e-200346ca4f26 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:55.152322 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-52455930-8224-4ad3-b48e-200346ca4f26 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:55.152762 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-52455930-8224-4ad3-b48e-200346ca4f26 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:55.153549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-52455930-8224-4ad3-b48e-200346ca4f26 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:55.154020 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-52455930-8224-4ad3-b48e-200346ca4f26 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:55.233529 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-52455930-8224-4ad3-b48e-200346ca4f26 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:55.247193 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-52455930-8224-4ad3-b48e-200346ca4f26 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1211 microversion: 2.1 time: 0.108566 Jul 18 10:56:55.247698 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 494/1016] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:55 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:55.665917 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e35f4750-9d21-481e-ba27-eafedc5789c7 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:55.666608 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-e35f4750-9d21-481e-ba27-eafedc5789c7 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:55.673132 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e35f4750-9d21-481e-ba27-eafedc5789c7 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:55.673589 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e35f4750-9d21-481e-ba27-eafedc5789c7 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:55.674531 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e35f4750-9d21-481e-ba27-eafedc5789c7 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:55.674972 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e35f4750-9d21-481e-ba27-eafedc5789c7 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:55.822131 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-e35f4750-9d21-481e-ba27-eafedc5789c7 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:55.830055 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e35f4750-9d21-481e-ba27-eafedc5789c7 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1319 microversion: 2.1 time: 0.168872 Jul 18 10:56:55.830796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 523/1017] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:55 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:56.290885 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-874e683e-6929-4521-856f-647ac572e479 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:56.291531 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-874e683e-6929-4521-856f-647ac572e479 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:56.300214 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-874e683e-6929-4521-856f-647ac572e479 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:56.300660 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-874e683e-6929-4521-856f-647ac572e479 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:56.301547 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-874e683e-6929-4521-856f-647ac572e479 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:56.301987 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-874e683e-6929-4521-856f-647ac572e479 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:56.389319 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-874e683e-6929-4521-856f-647ac572e479 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:56.397629 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-874e683e-6929-4521-856f-647ac572e479 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1267 microversion: 2.1 time: 0.110905 Jul 18 10:56:56.398242 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 495/1018] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:56 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1267 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:56.849550 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-22ea2935-886d-47c0-83b4-0f8d7e486590 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:56.850187 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-22ea2935-886d-47c0-83b4-0f8d7e486590 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:56.859049 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-22ea2935-886d-47c0-83b4-0f8d7e486590 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:56.859780 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-22ea2935-886d-47c0-83b4-0f8d7e486590 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:56.860683 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-22ea2935-886d-47c0-83b4-0f8d7e486590 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:56.861174 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-22ea2935-886d-47c0-83b4-0f8d7e486590 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:57.050889 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-22ea2935-886d-47c0-83b4-0f8d7e486590 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:57.059420 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-22ea2935-886d-47c0-83b4-0f8d7e486590 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1319 microversion: 2.1 time: 0.214798 Jul 18 10:56:57.060008 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 524/1019] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:56 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:57.417364 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-71917c86-6f08-4c60-a8f2-b2aab8d91bbd tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:57.418181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-71917c86-6f08-4c60-a8f2-b2aab8d91bbd tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:57.427129 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-71917c86-6f08-4c60-a8f2-b2aab8d91bbd tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:57.428252 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-71917c86-6f08-4c60-a8f2-b2aab8d91bbd tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:57.429066 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-71917c86-6f08-4c60-a8f2-b2aab8d91bbd tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:57.429501 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-71917c86-6f08-4c60-a8f2-b2aab8d91bbd tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:57.664727 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-71917c86-6f08-4c60-a8f2-b2aab8d91bbd tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:57.674908 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-71917c86-6f08-4c60-a8f2-b2aab8d91bbd tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1285 microversion: 2.1 time: 0.262511 Jul 18 10:56:57.675833 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 496/1020] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:57 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1285 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:58.081215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-7ed90113-acee-4b2d-be7b-5805215fdbd3 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:58.082292 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-7ed90113-acee-4b2d-be7b-5805215fdbd3 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:58.091194 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ed90113-acee-4b2d-be7b-5805215fdbd3 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:58.092251 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ed90113-acee-4b2d-be7b-5805215fdbd3 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:58.093494 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ed90113-acee-4b2d-be7b-5805215fdbd3 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:58.093932 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ed90113-acee-4b2d-be7b-5805215fdbd3 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:58.257087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7ed90113-acee-4b2d-be7b-5805215fdbd3 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:58.268478 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-7ed90113-acee-4b2d-be7b-5805215fdbd3 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1508 microversion: 2.1 time: 0.193990 Jul 18 10:56:58.269650 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 525/1021] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:58 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:56:58.695835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7183549e-ed25-4d39-b5cb-717606f59491 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:56:58.696935 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-7183549e-ed25-4d39-b5cb-717606f59491 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:56:58.708967 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7183549e-ed25-4d39-b5cb-717606f59491 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:58.709719 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7183549e-ed25-4d39-b5cb-717606f59491 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:58.711111 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7183549e-ed25-4d39-b5cb-717606f59491 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:56:58.711779 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7183549e-ed25-4d39-b5cb-717606f59491 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:56:59.261538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7183549e-ed25-4d39-b5cb-717606f59491 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:56:59.273917 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7183549e-ed25-4d39-b5cb-717606f59491 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1315 microversion: 2.1 time: 0.584014 Jul 18 10:56:59.275046 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 497/1022] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:56:58 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:00.046475 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-49ea973e-11e4-4a53-8e6e-9583a1c69654 req-ccd58b71-acf2-41b1-bd16-3eb0e0e8cc3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d4e9152-18e1-4d31-857c-68cf93911bc8", "tag": "be149415-2daf-40aa-b6d3-27a3887e4858"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:00.057192 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-49ea973e-11e4-4a53-8e6e-9583a1c69654 req-ccd58b71-acf2-41b1-bd16-3eb0e0e8cc3d service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:00.057831 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-49ea973e-11e4-4a53-8e6e-9583a1c69654 req-ccd58b71-acf2-41b1-bd16-3eb0e0e8cc3d service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:00.094810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-49ea973e-11e4-4a53-8e6e-9583a1c69654 req-ccd58b71-acf2-41b1-bd16-3eb0e0e8cc3d service nova] Creating event network-changed:be149415-2daf-40aa-b6d3-27a3887e4858 for instance 0d4e9152-18e1-4d31-857c-68cf93911bc8 on hv-cinder-84949 Jul 18 10:57:00.117297 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-49ea973e-11e4-4a53-8e6e-9583a1c69654 req-ccd58b71-acf2-41b1-bd16-3eb0e0e8cc3d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074613 Jul 18 10:57:00.119819 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 526/1023] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:57:00.308051 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8161acad-0289-422a-a376-003e48b37da5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:00.309769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8161acad-0289-422a-a376-003e48b37da5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:00.320076 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8161acad-0289-422a-a376-003e48b37da5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:00.320801 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8161acad-0289-422a-a376-003e48b37da5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:00.321894 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8161acad-0289-422a-a376-003e48b37da5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:00.322258 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8161acad-0289-422a-a376-003e48b37da5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:00.659593 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8161acad-0289-422a-a376-003e48b37da5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:00.671850 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8161acad-0289-422a-a376-003e48b37da5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1315 microversion: 2.1 time: 0.381203 Jul 18 10:57:00.673081 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 498/1024] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:00 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:01.696833 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-108d7cdf-589e-494d-bfaf-6332f27e45c2 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:01.697545 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-108d7cdf-589e-494d-bfaf-6332f27e45c2 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:01.706090 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-108d7cdf-589e-494d-bfaf-6332f27e45c2 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:01.706746 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-108d7cdf-589e-494d-bfaf-6332f27e45c2 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:01.707509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-108d7cdf-589e-494d-bfaf-6332f27e45c2 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:01.707970 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-108d7cdf-589e-494d-bfaf-6332f27e45c2 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:01.953358 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-108d7cdf-589e-494d-bfaf-6332f27e45c2 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:01.961517 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-108d7cdf-589e-494d-bfaf-6332f27e45c2 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1315 microversion: 2.1 time: 0.270865 Jul 18 10:57:01.962111 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 527/1025] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:01 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:02.979186 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-0fe7f558-bb19-465b-8d04-076dbb9fa178 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:02.979804 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-0fe7f558-bb19-465b-8d04-076dbb9fa178 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:02.982309 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=2 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:02.982982 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=8 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:02.988234 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0fe7f558-bb19-465b-8d04-076dbb9fa178 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:02.988684 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0fe7f558-bb19-465b-8d04-076dbb9fa178 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:02.989504 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0fe7f558-bb19-465b-8d04-076dbb9fa178 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:02.989939 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0fe7f558-bb19-465b-8d04-076dbb9fa178 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:03.212903 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-0fe7f558-bb19-465b-8d04-076dbb9fa178 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:03.221625 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-0fe7f558-bb19-465b-8d04-076dbb9fa178 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1315 microversion: 2.1 time: 0.246161 Jul 18 10:57:03.222443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 499/1026] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:02 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:04.239526 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-57d245e3-dcae-4891-a788-1e7712c1fe32 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:04.240152 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-57d245e3-dcae-4891-a788-1e7712c1fe32 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:04.253440 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=12 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:04.255115 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-57d245e3-dcae-4891-a788-1e7712c1fe32 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:04.255766 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-57d245e3-dcae-4891-a788-1e7712c1fe32 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:04.256758 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-57d245e3-dcae-4891-a788-1e7712c1fe32 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:04.257471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-57d245e3-dcae-4891-a788-1e7712c1fe32 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:04.528397 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-57d245e3-dcae-4891-a788-1e7712c1fe32 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:04.553358 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-57d245e3-dcae-4891-a788-1e7712c1fe32 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1315 microversion: 2.1 time: 0.305394 Jul 18 10:57:04.555408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 528/1027] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:04 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:05.565594 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e005dea6-9c53-4861-bb2d-78219cdf8e45 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:05.567761 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e005dea6-9c53-4861-bb2d-78219cdf8e45 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:05.586245 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e005dea6-9c53-4861-bb2d-78219cdf8e45 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:05.586984 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e005dea6-9c53-4861-bb2d-78219cdf8e45 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:05.588189 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e005dea6-9c53-4861-bb2d-78219cdf8e45 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:05.589040 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e005dea6-9c53-4861-bb2d-78219cdf8e45 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:05.775950 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-e005dea6-9c53-4861-bb2d-78219cdf8e45 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:05.790384 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e005dea6-9c53-4861-bb2d-78219cdf8e45 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1315 microversion: 2.1 time: 0.232177 Jul 18 10:57:05.792446 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 500/1028] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:05 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:06.812320 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6b055fdf-e3af-4e85-84eb-e0f060d6bbaa tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:06.813671 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6b055fdf-e3af-4e85-84eb-e0f060d6bbaa tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:06.826657 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6b055fdf-e3af-4e85-84eb-e0f060d6bbaa tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:06.827176 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6b055fdf-e3af-4e85-84eb-e0f060d6bbaa tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:06.828161 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6b055fdf-e3af-4e85-84eb-e0f060d6bbaa tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:06.828611 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6b055fdf-e3af-4e85-84eb-e0f060d6bbaa tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:07.040631 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-02058ca3-1121-4595-97da-3d934ad24028 req-bbdf413d-f035-413a-9577-8436fb8f384a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4e9152-18e1-4d31-857c-68cf93911bc8", "name": "network-vif-plugged", "status": "completed", "tag": "be149415-2daf-40aa-b6d3-27a3887e4858"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:07.064570 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-02058ca3-1121-4595-97da-3d934ad24028 req-bbdf413d-f035-413a-9577-8436fb8f384a service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:07.065604 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-02058ca3-1121-4595-97da-3d934ad24028 req-bbdf413d-f035-413a-9577-8436fb8f384a service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:07.100042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-6b055fdf-e3af-4e85-84eb-e0f060d6bbaa tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:07.101488 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-02058ca3-1121-4595-97da-3d934ad24028 req-bbdf413d-f035-413a-9577-8436fb8f384a service nova] Creating event network-vif-plugged:be149415-2daf-40aa-b6d3-27a3887e4858 for instance 0d4e9152-18e1-4d31-857c-68cf93911bc8 on hv-cinder-84949 Jul 18 10:57:07.116166 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-02058ca3-1121-4595-97da-3d934ad24028 req-bbdf413d-f035-413a-9577-8436fb8f384a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081246 Jul 18 10:57:07.118695 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6b055fdf-e3af-4e85-84eb-e0f060d6bbaa tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1315 microversion: 2.1 time: 0.310001 Jul 18 10:57:07.119108 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 501/1030] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:57:07.119273 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 529/1030] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:06 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:57:08.146460 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-9f496205-f677-4ae6-8fa7-8b9d84fb81d1 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:08.148068 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-9f496205-f677-4ae6-8fa7-8b9d84fb81d1 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:08.166152 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9f496205-f677-4ae6-8fa7-8b9d84fb81d1 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:08.166774 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9f496205-f677-4ae6-8fa7-8b9d84fb81d1 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:08.167666 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9f496205-f677-4ae6-8fa7-8b9d84fb81d1 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:08.168227 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-9f496205-f677-4ae6-8fa7-8b9d84fb81d1 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:08.572610 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-9f496205-f677-4ae6-8fa7-8b9d84fb81d1 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:08.589284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-9f496205-f677-4ae6-8fa7-8b9d84fb81d1 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1315 microversion: 2.1 time: 0.450550 Jul 18 10:57:08.590235 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 502/1031] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:08 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:09.611004 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d17cd0c5-3b3f-43e9-be7a-c3fc11dde7d5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:09.611627 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d17cd0c5-3b3f-43e9-be7a-c3fc11dde7d5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:09.620403 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d17cd0c5-3b3f-43e9-be7a-c3fc11dde7d5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:09.620747 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d17cd0c5-3b3f-43e9-be7a-c3fc11dde7d5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:09.621543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d17cd0c5-3b3f-43e9-be7a-c3fc11dde7d5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:09.621994 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d17cd0c5-3b3f-43e9-be7a-c3fc11dde7d5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:09.923118 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d17cd0c5-3b3f-43e9-be7a-c3fc11dde7d5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:09.933367 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d17cd0c5-3b3f-43e9-be7a-c3fc11dde7d5 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1465 microversion: 2.1 time: 0.328004 Jul 18 10:57:09.933962 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 530/1032] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:09 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1465 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:10.002932 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2e68c938-1db6-48f6-bbc5-2ec04cce97ff tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:10.004987 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2e68c938-1db6-48f6-bbc5-2ec04cce97ff tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:10.012500 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2e68c938-1db6-48f6-bbc5-2ec04cce97ff tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:10.013606 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2e68c938-1db6-48f6-bbc5-2ec04cce97ff tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:10.014411 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2e68c938-1db6-48f6-bbc5-2ec04cce97ff tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:10.014872 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2e68c938-1db6-48f6-bbc5-2ec04cce97ff tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:10.042443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2e68c938-1db6-48f6-bbc5-2ec04cce97ff tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Going to try to terminate instance {{(pid=125005) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:57:10.094538 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:10.474209 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2e68c938-1db6-48f6-bbc5-2ec04cce97ff tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 204 len: 0 microversion: 2.1 time: 0.476615 Jul 18 10:57:10.475013 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 503/1033] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:57:09 2022] DELETE /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:57:10.484110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d464c4a1-40e3-4101-9e0a-7f6550315331 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:10.492792 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d464c4a1-40e3-4101-9e0a-7f6550315331 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:10.501529 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d464c4a1-40e3-4101-9e0a-7f6550315331 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:10.502300 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d464c4a1-40e3-4101-9e0a-7f6550315331 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:10.503285 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d464c4a1-40e3-4101-9e0a-7f6550315331 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:10.504009 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d464c4a1-40e3-4101-9e0a-7f6550315331 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:10.714702 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d464c4a1-40e3-4101-9e0a-7f6550315331 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:10.733477 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d464c4a1-40e3-4101-9e0a-7f6550315331 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1471 microversion: 2.1 time: 0.253801 Jul 18 10:57:10.735705 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 531/1034] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:10 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:11.751786 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-4bd93730-bfcd-440d-8160-630a5d4299a3 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:11.752489 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-4bd93730-bfcd-440d-8160-630a5d4299a3 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:11.760498 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4bd93730-bfcd-440d-8160-630a5d4299a3 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:11.761152 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4bd93730-bfcd-440d-8160-630a5d4299a3 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:11.761946 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4bd93730-bfcd-440d-8160-630a5d4299a3 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:11.762514 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4bd93730-bfcd-440d-8160-630a5d4299a3 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:11.973672 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4bd93730-bfcd-440d-8160-630a5d4299a3 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:11.984161 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-4bd93730-bfcd-440d-8160-630a5d4299a3 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1471 microversion: 2.1 time: 0.236984 Jul 18 10:57:11.985565 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 504/1035] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:11 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:12.703325 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-695499c4-b94a-4ff1-aa55-e457ad70f31b req-7e8fcbd6-4951-4809-a50c-e62d055d8ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4e9152-18e1-4d31-857c-68cf93911bc8", "name": "network-vif-deleted", "tag": "be149415-2daf-40aa-b6d3-27a3887e4858"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:12.710501 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:12.727260 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-695499c4-b94a-4ff1-aa55-e457ad70f31b req-7e8fcbd6-4951-4809-a50c-e62d055d8ccf service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:12.728012 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-695499c4-b94a-4ff1-aa55-e457ad70f31b req-7e8fcbd6-4951-4809-a50c-e62d055d8ccf service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:12.753299 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=75 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:12.755860 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-695499c4-b94a-4ff1-aa55-e457ad70f31b req-7e8fcbd6-4951-4809-a50c-e62d055d8ccf service nova] Creating event network-vif-deleted:be149415-2daf-40aa-b6d3-27a3887e4858 for instance 0d4e9152-18e1-4d31-857c-68cf93911bc8 on hv-cinder-84949 Jul 18 10:57:12.762699 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-695499c4-b94a-4ff1-aa55-e457ad70f31b req-7e8fcbd6-4951-4809-a50c-e62d055d8ccf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064139 Jul 18 10:57:12.769937 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 532/1036] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:57:13.002837 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-fb73a2d8-37eb-4654-9200-2bacffa84861 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:13.004416 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-fb73a2d8-37eb-4654-9200-2bacffa84861 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:13.012431 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fb73a2d8-37eb-4654-9200-2bacffa84861 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:13.013338 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fb73a2d8-37eb-4654-9200-2bacffa84861 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:13.014665 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fb73a2d8-37eb-4654-9200-2bacffa84861 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:13.016341 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fb73a2d8-37eb-4654-9200-2bacffa84861 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:13.117136 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-fb73a2d8-37eb-4654-9200-2bacffa84861 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc605fb8be754d14b21de88330efe013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccc8499e2e24dfa8bd8eb8ea1978ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:13.127308 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-fb73a2d8-37eb-4654-9200-2bacffa84861 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 200 len: 1300 microversion: 2.1 time: 0.128574 Jul 18 10:57:13.127892 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 505/1037] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:12 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 1300 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:14.150734 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-1ff10cf3-a8de-4732-bf7c-a3e1fa700949 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:14.151918 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-1ff10cf3-a8de-4732-bf7c-a3e1fa700949 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] [instance: 0d4e9152-18e1-4d31-857c-68cf93911bc8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:14.189915 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1ff10cf3-a8de-4732-bf7c-a3e1fa700949 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:14.190745 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1ff10cf3-a8de-4732-bf7c-a3e1fa700949 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:14.192253 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1ff10cf3-a8de-4732-bf7c-a3e1fa700949 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:14.192998 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1ff10cf3-a8de-4732-bf7c-a3e1fa700949 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:14.221457 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-1ff10cf3-a8de-4732-bf7c-a3e1fa700949 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] HTTP exception thrown: Instance 0d4e9152-18e1-4d31-857c-68cf93911bc8 could not be found. Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-1ff10cf3-a8de-4732-bf7c-a3e1fa700949 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Request method failure captured: Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 HTTP/1.1 Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1Txy1P4oEhryd8Em6GUIuVc4-zo3m_eSJUAVGoN2Go6g94IeDcuJjs9fgTRO76zK2PJyPSYjrhImFE4v9JeEjTfNWMPdxYrmUKH7NhtQf2lkfokBorVsxagN8pkKbzSpxmLQPu-FsikktUSe_STyNJvRibgcaosqH_7Ox_W7plU9tT4 Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 6ccc8499e2e24dfa8bd8eb8ea1978ba7 Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-VolumesNegativeTest-879689978 Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:57:14.223820 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:57:14.226343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6ccc8499e2e24dfa8bd8eb8ea1978ba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6ccc8499e2e24dfa8bd8eb8ea1978ba7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6ccc8499e2e24dfa8bd8eb8ea1978ba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6ccc8499e2e24dfa8bd8eb8ea1978ba7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:57:14.226343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-VolumesNegativeTest-879689978 Jul 18 10:57:14.226343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 6ccc8499e2e24dfa8bd8eb8ea1978ba7 Jul 18 10:57:14.226343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-VolumesNegativeTest-879689978 Jul 18 10:57:14.226343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-VolumesNegativeTest-879689978-project Jul 18 10:57:14.226343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:57:14.226343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:57:14.226343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: bc605fb8be754d14b21de88330efe013 Jul 18 10:57:14.226343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-VolumesNegativeTest-879689978-project Jul 18 10:57:14.226343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:57:14.226343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 0d4e9152-18e1-4d31-857c-68cf93911bc8 could not be found. Jul 18 10:57:14.226343 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '0d4e9152-18e1-4d31-857c-68cf93911bc8'} Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d4e9152-18e1-4d31-857c-68cf93911bc8 could not be found. Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:57:14.227354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d4e9152-18e1-4d31-857c-68cf93911bc8 could not be found. Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d4e9152-18e1-4d31-857c-68cf93911bc8 could not be found. Jul 18 10:57:14.228974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:57:14.231344 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-1ff10cf3-a8de-4732-bf7c-a3e1fa700949 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] Returning 404 to user: Instance 0d4e9152-18e1-4d31-857c-68cf93911bc8 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:57:14.232236 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-1ff10cf3-a8de-4732-bf7c-a3e1fa700949 tempest-VolumesNegativeTest-879689978 tempest-VolumesNegativeTest-879689978-project] 10.222.0.49 "GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8" status: 404 len: 111 microversion: 2.1 time: 0.088881 Jul 18 10:57:14.233291 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 533/1038] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:14 2022] GET /compute/v2.1/servers/0d4e9152-18e1-4d31-857c-68cf93911bc8 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:57:15.503717 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-033ed216-2113-4a06-b97f-3e2743545b97 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6aa9d04-2289-4893-89ad-b279a60c239a", "device": "/dev/sdb"}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:15.506108 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-033ed216-2113-4a06-b97f-3e2743545b97 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:15.509440 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:15.516686 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-033ed216-2113-4a06-b97f-3e2743545b97 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:15.517678 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-033ed216-2113-4a06-b97f-3e2743545b97 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:15.519079 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-033ed216-2113-4a06-b97f-3e2743545b97 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:15.519527 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-033ed216-2113-4a06-b97f-3e2743545b97 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:16.752826 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-033ed216-2113-4a06-b97f-3e2743545b97 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "POST /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.254592 Jul 18 10:57:16.756033 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 506/1039] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 18 10:57:15 2022] POST /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79/os-volume_attachments => generated 194 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:57:26.099909 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2195fd63-d22c-4edb-a1bd-4c759f9fae18 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Action: 'create', calling method: .version_select at 0x7f6364b87af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-388273449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzKZjfPza+MBXrVU9CG4Ob7vNoHOcuYUdJdVTmWZy3xPYx/nXtxmjBUUjBQf7RmAvk20EU050uAzDT7XyM3yh3LAsZsWbgfZp3VS7Jj5YFc3eF3FMnKjgPT/GvYyJbUSw=="}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:26.116940 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=3 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:26.126941 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=3 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:26.132885 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-2195fd63-d22c-4edb-a1bd-4c759f9fae18 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Getting quotas for project abc1cd8a20854cb0ac847cf30c1343eb. Resources: {'key_pairs'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:57:26.138815 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.quota [None req-2195fd63-d22c-4edb-a1bd-4c759f9fae18 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Getting quotas for user 5275b73fe98746879d090ab7713afd1e and project abc1cd8a20854cb0ac847cf30c1343eb. Resources: {'key_pairs'} {{(pid=125007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:57:26.288762 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2195fd63-d22c-4edb-a1bd-4c759f9fae18 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.198493 Jul 18 10:57:26.289593 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 534/1040] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 18 10:57:26 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:57:26.398782 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1907995512", "imageRef": "f6a19d57-819c-4b01-8a63-70f22f25fab2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-388273449", "networks": [{"uuid": "bd6b2d5f-f3f8-441c-bdf6-1710c3bbd5c6"}]}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:26.407192 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:26.593772 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:26.682642 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.network.neutron [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] validate_networks() for [('bd6b2d5f-f3f8-441c-bdf6-1710c3bbd5c6', None, None, None, None, None)] {{(pid=125005) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:57:27.157396 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Flavor limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:57:27.157819 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Image limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:57:27.158286 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Flavor pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:57:27.158694 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Image pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:57:27.159106 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:57:27.169072 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:27.169406 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:27.170204 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:27.170635 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:27.188228 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Getting quotas for project abc1cd8a20854cb0ac847cf30c1343eb. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:57:27.192416 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Getting quotas for user 5275b73fe98746879d090ab7713afd1e and project abc1cd8a20854cb0ac847cf30c1343eb. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:57:27.207691 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Going to run 1 instances... {{(pid=125005) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:57:27.211627 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a19d57-819c-4b01-8a63-70f22f25fab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125005) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:57:27.413108 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f001f68a-edf5-42f7-b834-9028b686d4e7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.018847 Jul 18 10:57:27.413884 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 507/1041] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:57:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:57:27.426110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-df1139a8-714a-437d-9aa8-95f514ba1ca0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:27.426892 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-df1139a8-714a-437d-9aa8-95f514ba1ca0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:27.624716 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-df1139a8-714a-437d-9aa8-95f514ba1ca0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:27.633884 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-df1139a8-714a-437d-9aa8-95f514ba1ca0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1258 microversion: 2.1 time: 0.212189 Jul 18 10:57:27.634485 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 535/1042] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:27 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1258 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:57:28.655157 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-fc411db0-195b-42fe-9db9-23ee492bf40e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:28.655761 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-fc411db0-195b-42fe-9db9-23ee492bf40e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:28.712642 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-fc411db0-195b-42fe-9db9-23ee492bf40e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:28.721298 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-fc411db0-195b-42fe-9db9-23ee492bf40e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1258 microversion: 2.1 time: 0.071447 Jul 18 10:57:28.721875 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 508/1043] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:28 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:29.740562 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3fecc1b4-f8c4-42aa-bb39-64a11f316f48 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:29.741197 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3fecc1b4-f8c4-42aa-bb39-64a11f316f48 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:29.748683 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3fecc1b4-f8c4-42aa-bb39-64a11f316f48 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:29.749157 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3fecc1b4-f8c4-42aa-bb39-64a11f316f48 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:29.750264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3fecc1b4-f8c4-42aa-bb39-64a11f316f48 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:29.750696 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3fecc1b4-f8c4-42aa-bb39-64a11f316f48 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:29.816054 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3fecc1b4-f8c4-42aa-bb39-64a11f316f48 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:29.824555 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3fecc1b4-f8c4-42aa-bb39-64a11f316f48 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1262 microversion: 2.1 time: 0.088014 Jul 18 10:57:29.825436 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 536/1044] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:29 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:30.844118 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-2bf7a97f-06a3-4667-81c0-f0150199db2d tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:30.854422 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-2bf7a97f-06a3-4667-81c0-f0150199db2d tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:30.854422 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2bf7a97f-06a3-4667-81c0-f0150199db2d tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:30.854422 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2bf7a97f-06a3-4667-81c0-f0150199db2d tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:30.854422 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2bf7a97f-06a3-4667-81c0-f0150199db2d tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:30.855111 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-2bf7a97f-06a3-4667-81c0-f0150199db2d tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:30.926765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-2bf7a97f-06a3-4667-81c0-f0150199db2d tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:30.935501 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-2bf7a97f-06a3-4667-81c0-f0150199db2d tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1318 microversion: 2.1 time: 0.096628 Jul 18 10:57:30.936300 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 509/1045] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:30 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1318 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:31.954497 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-6341d5b4-1608-4d7a-aca8-5d1eb1a627e9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:31.955183 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-6341d5b4-1608-4d7a-aca8-5d1eb1a627e9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:31.962469 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6341d5b4-1608-4d7a-aca8-5d1eb1a627e9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:31.962919 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6341d5b4-1608-4d7a-aca8-5d1eb1a627e9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:31.963722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6341d5b4-1608-4d7a-aca8-5d1eb1a627e9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:31.964159 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-6341d5b4-1608-4d7a-aca8-5d1eb1a627e9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:32.111686 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-6341d5b4-1608-4d7a-aca8-5d1eb1a627e9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:32.120017 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-6341d5b4-1608-4d7a-aca8-5d1eb1a627e9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.170442 Jul 18 10:57:32.120687 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 537/1046] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:31 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:33.139269 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7a650ed6-2fd4-4b96-8904-10f724c08380 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:33.139852 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-7a650ed6-2fd4-4b96-8904-10f724c08380 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:33.146372 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7a650ed6-2fd4-4b96-8904-10f724c08380 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:33.146809 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7a650ed6-2fd4-4b96-8904-10f724c08380 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:33.147570 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7a650ed6-2fd4-4b96-8904-10f724c08380 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:33.147992 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7a650ed6-2fd4-4b96-8904-10f724c08380 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:33.286525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-7a650ed6-2fd4-4b96-8904-10f724c08380 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:33.295395 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7a650ed6-2fd4-4b96-8904-10f724c08380 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.160665 Jul 18 10:57:33.295992 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 510/1047] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:33 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:34.312478 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-dbc393d9-e100-43b4-93d5-fe49c0a57466 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:34.313261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-dbc393d9-e100-43b4-93d5-fe49c0a57466 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:34.321865 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dbc393d9-e100-43b4-93d5-fe49c0a57466 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:34.322318 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dbc393d9-e100-43b4-93d5-fe49c0a57466 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:34.323319 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dbc393d9-e100-43b4-93d5-fe49c0a57466 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:34.323800 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-dbc393d9-e100-43b4-93d5-fe49c0a57466 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:34.560106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-dbc393d9-e100-43b4-93d5-fe49c0a57466 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:34.578568 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-dbc393d9-e100-43b4-93d5-fe49c0a57466 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.262031 Jul 18 10:57:34.578568 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 538/1048] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:34 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:35.592723 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-76370a1f-17f7-484b-b3dd-0d3ba274a45f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:35.593521 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-76370a1f-17f7-484b-b3dd-0d3ba274a45f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:35.603998 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-76370a1f-17f7-484b-b3dd-0d3ba274a45f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:35.604983 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-76370a1f-17f7-484b-b3dd-0d3ba274a45f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:35.606895 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-76370a1f-17f7-484b-b3dd-0d3ba274a45f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:35.607863 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-76370a1f-17f7-484b-b3dd-0d3ba274a45f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:35.836353 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-76370a1f-17f7-484b-b3dd-0d3ba274a45f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:35.851646 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-76370a1f-17f7-484b-b3dd-0d3ba274a45f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.264214 Jul 18 10:57:35.853185 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 511/1049] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:35 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:36.871332 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-d83c7977-f430-4932-a655-e3551878dd1c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:36.873074 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-d83c7977-f430-4932-a655-e3551878dd1c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:36.885007 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d83c7977-f430-4932-a655-e3551878dd1c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:36.885778 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d83c7977-f430-4932-a655-e3551878dd1c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:36.888408 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d83c7977-f430-4932-a655-e3551878dd1c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:36.889354 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-d83c7977-f430-4932-a655-e3551878dd1c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:37.141363 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-d83c7977-f430-4932-a655-e3551878dd1c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:37.152444 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-d83c7977-f430-4932-a655-e3551878dd1c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.285324 Jul 18 10:57:37.153698 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 539/1050] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:36 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:38.175843 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-af6a5dd4-eeb9-40c3-a1e6-7665882c91f6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:38.176456 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-af6a5dd4-eeb9-40c3-a1e6-7665882c91f6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:38.179047 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=2 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:38.185662 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-af6a5dd4-eeb9-40c3-a1e6-7665882c91f6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:38.186115 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-af6a5dd4-eeb9-40c3-a1e6-7665882c91f6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:38.187026 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-af6a5dd4-eeb9-40c3-a1e6-7665882c91f6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:38.187464 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-af6a5dd4-eeb9-40c3-a1e6-7665882c91f6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:38.399826 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-af6a5dd4-eeb9-40c3-a1e6-7665882c91f6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:38.410901 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-af6a5dd4-eeb9-40c3-a1e6-7665882c91f6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.238994 Jul 18 10:57:38.412045 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 512/1051] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:38 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:57:39.436558 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-898b52d8-7bad-4d45-a5dc-bf16ebe09214 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:39.437586 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-898b52d8-7bad-4d45-a5dc-bf16ebe09214 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:39.439515 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=6 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:39.446016 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-898b52d8-7bad-4d45-a5dc-bf16ebe09214 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:39.446466 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-898b52d8-7bad-4d45-a5dc-bf16ebe09214 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:39.447739 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-898b52d8-7bad-4d45-a5dc-bf16ebe09214 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:39.448470 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-898b52d8-7bad-4d45-a5dc-bf16ebe09214 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:39.670299 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-898b52d8-7bad-4d45-a5dc-bf16ebe09214 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:39.686226 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-898b52d8-7bad-4d45-a5dc-bf16ebe09214 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.253275 Jul 18 10:57:39.704933 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 540/1052] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:39 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:40.720726 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-60bcaa7c-55ec-4e04-beb6-f7f2bf954cff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:40.721800 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-60bcaa7c-55ec-4e04-beb6-f7f2bf954cff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:40.724457 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=8 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:40.734346 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-60bcaa7c-55ec-4e04-beb6-f7f2bf954cff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:40.735122 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-60bcaa7c-55ec-4e04-beb6-f7f2bf954cff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:40.736605 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-60bcaa7c-55ec-4e04-beb6-f7f2bf954cff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:40.741129 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-60bcaa7c-55ec-4e04-beb6-f7f2bf954cff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:40.962036 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-60bcaa7c-55ec-4e04-beb6-f7f2bf954cff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:40.980413 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-60bcaa7c-55ec-4e04-beb6-f7f2bf954cff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.269597 Jul 18 10:57:40.997129 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 513/1053] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:40 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:42.009177 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-966246d2-c4e2-42ac-9661-d9aa7bb245d6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:42.010085 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-966246d2-c4e2-42ac-9661-d9aa7bb245d6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:42.028078 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-966246d2-c4e2-42ac-9661-d9aa7bb245d6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:42.029622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-966246d2-c4e2-42ac-9661-d9aa7bb245d6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:42.031324 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-966246d2-c4e2-42ac-9661-d9aa7bb245d6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:42.032347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-966246d2-c4e2-42ac-9661-d9aa7bb245d6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:42.265294 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-966246d2-c4e2-42ac-9661-d9aa7bb245d6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:42.273937 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-966246d2-c4e2-42ac-9661-d9aa7bb245d6 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.273480 Jul 18 10:57:42.276509 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 541/1054] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:41 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:43.300104 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3be63ecb-2070-456d-af61-326ca43811c0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:43.301196 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3be63ecb-2070-456d-af61-326ca43811c0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:43.309711 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3be63ecb-2070-456d-af61-326ca43811c0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:43.310340 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3be63ecb-2070-456d-af61-326ca43811c0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:43.311434 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3be63ecb-2070-456d-af61-326ca43811c0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:43.311945 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3be63ecb-2070-456d-af61-326ca43811c0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:44.301632 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3be63ecb-2070-456d-af61-326ca43811c0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:44.311076 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3be63ecb-2070-456d-af61-326ca43811c0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 1.015268 Jul 18 10:57:44.311679 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 514/1055] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:43 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:57:44.906393 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-715ae2bc-2bce-4870-a3a3-20dab8bb8bdb tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:44.910693 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-715ae2bc-2bce-4870-a3a3-20dab8bb8bdb tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:44.914068 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-715ae2bc-2bce-4870-a3a3-20dab8bb8bdb tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:44.914871 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-715ae2bc-2bce-4870-a3a3-20dab8bb8bdb tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:44.915841 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-715ae2bc-2bce-4870-a3a3-20dab8bb8bdb tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:44.917024 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-715ae2bc-2bce-4870-a3a3-20dab8bb8bdb tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:44.946321 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-b00fc341-aadf-4b01-8636-0a3b4a255b26 req-5d042d9b-d924-4794-9eab-81f63b8e7e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "876868b6-0929-4e64-b86c-274d075180e8", "tag": "024aed1d-8cc5-44ea-a5be-0e2863bf4794"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:44.947498 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-715ae2bc-2bce-4870-a3a3-20dab8bb8bdb tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Going to try to terminate instance {{(pid=125007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:57:44.958072 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-b00fc341-aadf-4b01-8636-0a3b4a255b26 req-5d042d9b-d924-4794-9eab-81f63b8e7e29 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:44.958616 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-b00fc341-aadf-4b01-8636-0a3b4a255b26 req-5d042d9b-d924-4794-9eab-81f63b8e7e29 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:44.982292 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-b00fc341-aadf-4b01-8636-0a3b4a255b26 req-5d042d9b-d924-4794-9eab-81f63b8e7e29 service nova] Creating event network-changed:024aed1d-8cc5-44ea-a5be-0e2863bf4794 for instance 876868b6-0929-4e64-b86c-274d075180e8 on hv-cinder-84949 Jul 18 10:57:44.989820 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-b00fc341-aadf-4b01-8636-0a3b4a255b26 req-5d042d9b-d924-4794-9eab-81f63b8e7e29 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048288 Jul 18 10:57:44.991432 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 515/1056] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:57:45.328772 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-71d32642-d7df-4143-8ed4-b12fdcefb576 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:45.333469 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-715ae2bc-2bce-4870-a3a3-20dab8bb8bdb tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "DELETE /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 204 len: 0 microversion: 2.1 time: 0.431927 Jul 18 10:57:45.334759 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 542/1057] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:57:44 2022] DELETE /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:57:45.336204 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-71d32642-d7df-4143-8ed4-b12fdcefb576 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:45.351145 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-24052807-9411-4d98-8a08-b8f88658fc48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:45.352346 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-24052807-9411-4d98-8a08-b8f88658fc48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:45.360383 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-71d32642-d7df-4143-8ed4-b12fdcefb576 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:45.363576 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-71d32642-d7df-4143-8ed4-b12fdcefb576 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:45.367776 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-71d32642-d7df-4143-8ed4-b12fdcefb576 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:45.368610 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-71d32642-d7df-4143-8ed4-b12fdcefb576 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:45.373962 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-24052807-9411-4d98-8a08-b8f88658fc48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:45.374457 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-24052807-9411-4d98-8a08-b8f88658fc48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:45.375296 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-24052807-9411-4d98-8a08-b8f88658fc48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:45.375718 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-24052807-9411-4d98-8a08-b8f88658fc48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:45.657356 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-71d32642-d7df-4143-8ed4-b12fdcefb576 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:45.667084 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-71d32642-d7df-4143-8ed4-b12fdcefb576 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.342899 Jul 18 10:57:45.668077 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 516/1058] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:45 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:57:45.690183 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-24052807-9411-4d98-8a08-b8f88658fc48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:45.699117 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-24052807-9411-4d98-8a08-b8f88658fc48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1579 microversion: 2.1 time: 0.359541 Jul 18 10:57:45.700556 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 543/1059] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:45 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1579 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:57:45.817647 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-70be6307-1213-45bd-8b06-bba16ebf85b1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:45.818069 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-70be6307-1213-45bd-8b06-bba16ebf85b1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:45.825629 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-70be6307-1213-45bd-8b06-bba16ebf85b1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:45.826395 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-70be6307-1213-45bd-8b06-bba16ebf85b1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:45.827349 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-70be6307-1213-45bd-8b06-bba16ebf85b1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:45.828031 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-70be6307-1213-45bd-8b06-bba16ebf85b1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:45.925401 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-70be6307-1213-45bd-8b06-bba16ebf85b1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lazy-loading 'services' on Instance uuid 64981f66-63e8-4a97-8692-87aa75b7ac79 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:57:46.144436 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 10:57:46.144593 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Mon Jul 18 10:57:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79/os-volume_attachments/f6aa9d04-2289-4893-89ad-b279a60c239a (ip 10.222.0.49) !!! Jul 18 10:57:46.176219 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-70be6307-1213-45bd-8b06-bba16ebf85b1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "DELETE /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79/os-volume_attachments/f6aa9d04-2289-4893-89ad-b279a60c239a" status: 202 len: 0 microversion: 2.1 time: 0.362571 Jul 18 10:57:46.176843 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 517/1060] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 18 10:57:45 2022] DELETE /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79/os-volume_attachments/f6aa9d04-2289-4893-89ad-b279a60c239a => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:57:46.685742 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-fdfd80c5-b7b5-4597-92de-c9d262b92815 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:46.686353 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-fdfd80c5-b7b5-4597-92de-c9d262b92815 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:46.694276 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fdfd80c5-b7b5-4597-92de-c9d262b92815 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:46.699528 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fdfd80c5-b7b5-4597-92de-c9d262b92815 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:46.699528 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fdfd80c5-b7b5-4597-92de-c9d262b92815 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:46.699528 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fdfd80c5-b7b5-4597-92de-c9d262b92815 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:46.720090 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-31bc322d-821a-4d5e-b609-746b03a24b63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:46.721003 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-31bc322d-821a-4d5e-b609-746b03a24b63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:46.732243 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-31bc322d-821a-4d5e-b609-746b03a24b63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:46.733145 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-31bc322d-821a-4d5e-b609-746b03a24b63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:46.734185 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-31bc322d-821a-4d5e-b609-746b03a24b63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:46.734845 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-31bc322d-821a-4d5e-b609-746b03a24b63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:46.964736 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-fdfd80c5-b7b5-4597-92de-c9d262b92815 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:46.974744 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-fdfd80c5-b7b5-4597-92de-c9d262b92815 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.293027 Jul 18 10:57:46.975355 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 544/1061] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:46 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:46.992520 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-31bc322d-821a-4d5e-b609-746b03a24b63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:47.001984 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-31bc322d-821a-4d5e-b609-746b03a24b63 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1579 microversion: 2.1 time: 0.286319 Jul 18 10:57:47.001984 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 518/1062] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:46 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1579 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:57:47.008142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-68f97de2-a1fb-4691-8a4b-0c454d81a330 req-a45024cf-72ff-4f1e-bc10-7266f175efd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d23cc92-a156-4a44-8b76-f082f7c3484a", "tag": "f9f873c9-64f4-4f0f-a61d-410318c37f4a"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:47.018845 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-68f97de2-a1fb-4691-8a4b-0c454d81a330 req-a45024cf-72ff-4f1e-bc10-7266f175efd0 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:47.019306 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-68f97de2-a1fb-4691-8a4b-0c454d81a330 req-a45024cf-72ff-4f1e-bc10-7266f175efd0 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:47.032012 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-68f97de2-a1fb-4691-8a4b-0c454d81a330 req-a45024cf-72ff-4f1e-bc10-7266f175efd0 service nova] Creating event network-changed:f9f873c9-64f4-4f0f-a61d-410318c37f4a for instance 7d23cc92-a156-4a44-8b76-f082f7c3484a on hv-cinder-84949 Jul 18 10:57:47.044868 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-68f97de2-a1fb-4691-8a4b-0c454d81a330 req-a45024cf-72ff-4f1e-bc10-7266f175efd0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034167 Jul 18 10:57:47.044868 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 545/1063] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:57:47.992647 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-4325e46b-901d-4465-a5fb-a270424c5d59 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:47.993384 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-4325e46b-901d-4465-a5fb-a270424c5d59 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:48.001794 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4325e46b-901d-4465-a5fb-a270424c5d59 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:48.002387 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4325e46b-901d-4465-a5fb-a270424c5d59 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:48.003428 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4325e46b-901d-4465-a5fb-a270424c5d59 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:48.004040 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4325e46b-901d-4465-a5fb-a270424c5d59 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:48.023562 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-20dd6dfd-e594-4d02-92bc-201a59e02147 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:48.024403 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-20dd6dfd-e594-4d02-92bc-201a59e02147 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:48.032587 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-20dd6dfd-e594-4d02-92bc-201a59e02147 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:48.033140 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-20dd6dfd-e594-4d02-92bc-201a59e02147 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:48.034154 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-20dd6dfd-e594-4d02-92bc-201a59e02147 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:48.034724 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-20dd6dfd-e594-4d02-92bc-201a59e02147 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:48.237638 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4325e46b-901d-4465-a5fb-a270424c5d59 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:48.250022 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-20dd6dfd-e594-4d02-92bc-201a59e02147 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:48.251664 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-4325e46b-901d-4465-a5fb-a270424c5d59 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.263054 Jul 18 10:57:48.259507 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-20dd6dfd-e594-4d02-92bc-201a59e02147 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1460 microversion: 2.1 time: 0.241191 Jul 18 10:57:48.260085 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 546/1064] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:48 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1460 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:57:48.263609 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 519/1065] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:47 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:48.347516 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-8d110ef2-5913-4f0a-b44f-220d03cc3413 req-0fbfe48e-4ae9-46d5-b5d8-fe9a11b7e59c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876868b6-0929-4e64-b86c-274d075180e8", "name": "network-vif-deleted", "tag": "024aed1d-8cc5-44ea-a5be-0e2863bf4794"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:48.357289 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-8d110ef2-5913-4f0a-b44f-220d03cc3413 req-0fbfe48e-4ae9-46d5-b5d8-fe9a11b7e59c service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:48.357839 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-8d110ef2-5913-4f0a-b44f-220d03cc3413 req-0fbfe48e-4ae9-46d5-b5d8-fe9a11b7e59c service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:48.370277 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-8d110ef2-5913-4f0a-b44f-220d03cc3413 req-0fbfe48e-4ae9-46d5-b5d8-fe9a11b7e59c service nova] Creating event network-vif-deleted:024aed1d-8cc5-44ea-a5be-0e2863bf4794 for instance 876868b6-0929-4e64-b86c-274d075180e8 on hv-cinder-84949 Jul 18 10:57:48.378053 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-8d110ef2-5913-4f0a-b44f-220d03cc3413 req-0fbfe48e-4ae9-46d5-b5d8-fe9a11b7e59c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034190 Jul 18 10:57:48.383577 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 547/1066] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:57:49.270364 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b421d616-1092-4dac-a127-3dd08ad58325 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:49.271181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b421d616-1092-4dac-a127-3dd08ad58325 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:49.279622 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-89a8f6b3-41c1-4f6b-bb94-55797af0653c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:49.280392 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-89a8f6b3-41c1-4f6b-bb94-55797af0653c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:49.290520 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-89a8f6b3-41c1-4f6b-bb94-55797af0653c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:49.290724 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b421d616-1092-4dac-a127-3dd08ad58325 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:49.291106 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-89a8f6b3-41c1-4f6b-bb94-55797af0653c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:49.291285 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b421d616-1092-4dac-a127-3dd08ad58325 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:49.291891 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-89a8f6b3-41c1-4f6b-bb94-55797af0653c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:49.292076 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b421d616-1092-4dac-a127-3dd08ad58325 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:49.292365 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b421d616-1092-4dac-a127-3dd08ad58325 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:49.292558 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-89a8f6b3-41c1-4f6b-bb94-55797af0653c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:49.457630 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-89a8f6b3-41c1-4f6b-bb94-55797af0653c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:49.482586 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-89a8f6b3-41c1-4f6b-bb94-55797af0653c tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1226 microversion: 2.1 time: 0.206336 Jul 18 10:57:49.484434 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 548/1067] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:49 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1226 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:49.518858 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-99d63d73-27ee-4e4c-a49d-34d427a688f8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:49.519948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-99d63d73-27ee-4e4c-a49d-34d427a688f8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:49.527725 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-99d63d73-27ee-4e4c-a49d-34d427a688f8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:49.528537 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-99d63d73-27ee-4e4c-a49d-34d427a688f8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:49.529823 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-99d63d73-27ee-4e4c-a49d-34d427a688f8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:49.530443 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-99d63d73-27ee-4e4c-a49d-34d427a688f8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:49.560722 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-99d63d73-27ee-4e4c-a49d-34d427a688f8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Going to try to terminate instance {{(pid=125007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:57:49.567120 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-b421d616-1092-4dac-a127-3dd08ad58325 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:49.577087 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b421d616-1092-4dac-a127-3dd08ad58325 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.311068 Jul 18 10:57:49.585348 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 520/1068] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:49 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:57:50.086266 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-99d63d73-27ee-4e4c-a49d-34d427a688f8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "DELETE /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 204 len: 0 microversion: 2.1 time: 0.573820 Jul 18 10:57:50.086994 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 549/1069] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:57:49 2022] DELETE /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 10:57:50.097647 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-bc6ceb5e-5c0c-4545-bcba-cc29a1f0d425 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:50.097647 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-bc6ceb5e-5c0c-4545-bcba-cc29a1f0d425 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:50.103439 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bc6ceb5e-5c0c-4545-bcba-cc29a1f0d425 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:50.103957 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bc6ceb5e-5c0c-4545-bcba-cc29a1f0d425 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:50.104667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bc6ceb5e-5c0c-4545-bcba-cc29a1f0d425 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:50.105145 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-bc6ceb5e-5c0c-4545-bcba-cc29a1f0d425 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:50.241935 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-bc6ceb5e-5c0c-4545-bcba-cc29a1f0d425 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:50.250400 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-bc6ceb5e-5c0c-4545-bcba-cc29a1f0d425 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1514 microversion: 2.1 time: 0.158216 Jul 18 10:57:50.250965 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 521/1070] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:50 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:57:50.511530 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-cfef6bba-4b30-45cf-9604-dbfb55342a48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:50.511530 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-cfef6bba-4b30-45cf-9604-dbfb55342a48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:50.511530 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cfef6bba-4b30-45cf-9604-dbfb55342a48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:50.513173 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cfef6bba-4b30-45cf-9604-dbfb55342a48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:50.513601 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cfef6bba-4b30-45cf-9604-dbfb55342a48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:50.514041 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cfef6bba-4b30-45cf-9604-dbfb55342a48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:50.535601 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:50.549966 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cfef6bba-4b30-45cf-9604-dbfb55342a48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:50.550422 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-cfef6bba-4b30-45cf-9604-dbfb55342a48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:50.550879 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-cfef6bba-4b30-45cf-9604-dbfb55342a48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lazy-loading 'fault' on Instance uuid 876868b6-0929-4e64-b86c-274d075180e8 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:57:50.599292 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-cfef6bba-4b30-45cf-9604-dbfb55342a48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:50.601144 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3a304cc7-fcec-41ff-a459-b6da07c2688e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:50.602170 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3a304cc7-fcec-41ff-a459-b6da07c2688e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:50.613138 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-cfef6bba-4b30-45cf-9604-dbfb55342a48 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1231 microversion: 2.1 time: 0.114073 Jul 18 10:57:50.614071 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3a304cc7-fcec-41ff-a459-b6da07c2688e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:50.614224 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 550/1071] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:50 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1231 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:50.614767 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3a304cc7-fcec-41ff-a459-b6da07c2688e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:50.615690 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3a304cc7-fcec-41ff-a459-b6da07c2688e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:50.616275 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3a304cc7-fcec-41ff-a459-b6da07c2688e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:50.772675 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3a304cc7-fcec-41ff-a459-b6da07c2688e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:50.782694 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3a304cc7-fcec-41ff-a459-b6da07c2688e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.189947 Jul 18 10:57:50.783637 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 522/1072] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:50 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:57:51.268252 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-665727b4-b0f5-4417-a391-3d2c0fc4bd68 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:51.268808 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-665727b4-b0f5-4417-a391-3d2c0fc4bd68 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:51.276010 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-665727b4-b0f5-4417-a391-3d2c0fc4bd68 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:51.276461 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-665727b4-b0f5-4417-a391-3d2c0fc4bd68 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:51.277863 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-665727b4-b0f5-4417-a391-3d2c0fc4bd68 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:51.278258 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-665727b4-b0f5-4417-a391-3d2c0fc4bd68 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:51.421520 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-665727b4-b0f5-4417-a391-3d2c0fc4bd68 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:51.429560 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-665727b4-b0f5-4417-a391-3d2c0fc4bd68 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1514 microversion: 2.1 time: 0.165274 Jul 18 10:57:51.430144 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 551/1073] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:51 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:51.633119 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a660510a-4545-4dff-873e-a8e9fbaef17e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:51.633755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a660510a-4545-4dff-873e-a8e9fbaef17e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:51.641134 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a660510a-4545-4dff-873e-a8e9fbaef17e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:51.641566 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a660510a-4545-4dff-873e-a8e9fbaef17e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:51.642337 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a660510a-4545-4dff-873e-a8e9fbaef17e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:51.642759 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a660510a-4545-4dff-873e-a8e9fbaef17e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:51.677983 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a660510a-4545-4dff-873e-a8e9fbaef17e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:51.678421 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a660510a-4545-4dff-873e-a8e9fbaef17e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:51.678871 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-a660510a-4545-4dff-873e-a8e9fbaef17e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lazy-loading 'fault' on Instance uuid 876868b6-0929-4e64-b86c-274d075180e8 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:57:51.722075 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a660510a-4545-4dff-873e-a8e9fbaef17e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:51.732486 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a660510a-4545-4dff-873e-a8e9fbaef17e tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 200 len: 1231 microversion: 2.1 time: 0.103171 Jul 18 10:57:51.733135 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 523/1074] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:51 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:51.812249 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-3e03b767-1b2f-4155-bd02-42cbdf97854c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:51.813713 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-3e03b767-1b2f-4155-bd02-42cbdf97854c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:51.821433 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3e03b767-1b2f-4155-bd02-42cbdf97854c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:51.823062 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3e03b767-1b2f-4155-bd02-42cbdf97854c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:51.823062 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3e03b767-1b2f-4155-bd02-42cbdf97854c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:51.823415 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-3e03b767-1b2f-4155-bd02-42cbdf97854c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:51.979385 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-3e03b767-1b2f-4155-bd02-42cbdf97854c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:51.988036 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-3e03b767-1b2f-4155-bd02-42cbdf97854c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.184358 Jul 18 10:57:51.988700 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 552/1075] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:51 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:52.448102 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-fb972244-3b72-4a2a-99c9-eb4e6a950c38 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:52.448970 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-fb972244-3b72-4a2a-99c9-eb4e6a950c38 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:52.455677 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fb972244-3b72-4a2a-99c9-eb4e6a950c38 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:52.456201 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fb972244-3b72-4a2a-99c9-eb4e6a950c38 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:52.457095 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fb972244-3b72-4a2a-99c9-eb4e6a950c38 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:52.457525 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-fb972244-3b72-4a2a-99c9-eb4e6a950c38 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:52.630657 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-fb972244-3b72-4a2a-99c9-eb4e6a950c38 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:52.635187 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:52.643036 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-60f110e4-a25c-4318-b7e6-a19018f57d64 req-37de4446-c98f-41f6-9747-fa25f6e7a77c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d23cc92-a156-4a44-8b76-f082f7c3484a", "name": "network-vif-plugged", "status": "completed", "tag": "f9f873c9-64f4-4f0f-a61d-410318c37f4a"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:52.646078 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-fb972244-3b72-4a2a-99c9-eb4e6a950c38 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1514 microversion: 2.1 time: 0.201436 Jul 18 10:57:52.648204 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 524/1076] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:52 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:52.655647 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-60f110e4-a25c-4318-b7e6-a19018f57d64 req-37de4446-c98f-41f6-9747-fa25f6e7a77c service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:52.657308 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-60f110e4-a25c-4318-b7e6-a19018f57d64 req-37de4446-c98f-41f6-9747-fa25f6e7a77c service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:52.678913 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-60f110e4-a25c-4318-b7e6-a19018f57d64 req-37de4446-c98f-41f6-9747-fa25f6e7a77c service nova] Creating event network-vif-plugged:f9f873c9-64f4-4f0f-a61d-410318c37f4a for instance 7d23cc92-a156-4a44-8b76-f082f7c3484a on hv-cinder-84949 Jul 18 10:57:52.686427 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-60f110e4-a25c-4318-b7e6-a19018f57d64 req-37de4446-c98f-41f6-9747-fa25f6e7a77c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049992 Jul 18 10:57:52.687272 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 553/1077] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:57:52.754390 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6e5276aa-507e-4230-a2de-3bbc7c01b4d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:52.755630 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-6e5276aa-507e-4230-a2de-3bbc7c01b4d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 876868b6-0929-4e64-b86c-274d075180e8] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:52.770809 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e5276aa-507e-4230-a2de-3bbc7c01b4d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:52.772110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e5276aa-507e-4230-a2de-3bbc7c01b4d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:52.773866 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e5276aa-507e-4230-a2de-3bbc7c01b4d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:52.774961 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e5276aa-507e-4230-a2de-3bbc7c01b4d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:52.799586 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-6e5276aa-507e-4230-a2de-3bbc7c01b4d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] HTTP exception thrown: Instance 876868b6-0929-4e64-b86c-274d075180e8 could not be found. Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6e5276aa-507e-4230-a2de-3bbc7c01b4d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Request method failure captured: Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 HTTP/1.1 Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1Tq9mlAHK0ystMhjyDb0YyO8U2hK7gGU1fUhDRpNQDWPyz-rISX1S04lsJPqJLD5MjfYJBjOs8RlHr0wD6AJXubnX1mFbTfY8w7JMXJAbxIlkuXby8pM0wO-ulmU3SBPUTAYPBrSsx5HpuARfVCkkhZFj-KX7C7-wHeLOUnh1eAJWYY Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 17f436162f3a4bd4b3a94f584e7d8782 Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-TestVolumeBootPattern-497016436 Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:57:52.801739 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:57:52.805769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:57:52.805769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-TestVolumeBootPattern-497016436 Jul 18 10:57:52.805769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 17f436162f3a4bd4b3a94f584e7d8782 Jul 18 10:57:52.805769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-TestVolumeBootPattern-497016436 Jul 18 10:57:52.805769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-TestVolumeBootPattern-497016436-project Jul 18 10:57:52.805769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:57:52.805769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:57:52.805769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: eb483b1aee944da8910dd7468a0ef4ac Jul 18 10:57:52.805769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-TestVolumeBootPattern-497016436-project Jul 18 10:57:52.805769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:57:52.805769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 876868b6-0929-4e64-b86c-274d075180e8 could not be found. Jul 18 10:57:52.805769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '876868b6-0929-4e64-b86c-274d075180e8'} Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 876868b6-0929-4e64-b86c-274d075180e8 could not be found. Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:57:52.806755 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 876868b6-0929-4e64-b86c-274d075180e8 could not be found. Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 876868b6-0929-4e64-b86c-274d075180e8 could not be found. Jul 18 10:57:52.809564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:57:52.811775 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6e5276aa-507e-4230-a2de-3bbc7c01b4d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Returning 404 to user: Instance 876868b6-0929-4e64-b86c-274d075180e8 could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:57:52.811775 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-6e5276aa-507e-4230-a2de-3bbc7c01b4d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8" status: 404 len: 111 microversion: 2.1 time: 0.056007 Jul 18 10:57:52.812861 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 525/1078] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:52 2022] GET /compute/v2.1/servers/876868b6-0929-4e64-b86c-274d075180e8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:57:52.937349 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-3c8056e2-5b01-44c1-8c9c-c07e7d4ff680 req-07b58900-68b4-47b6-8248-5ee15acdcc33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64981f66-63e8-4a97-8692-87aa75b7ac79", "name": "network-vif-deleted", "tag": "10521465-8839-40ca-b38b-0742f4477643"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:52.955974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-3c8056e2-5b01-44c1-8c9c-c07e7d4ff680 req-07b58900-68b4-47b6-8248-5ee15acdcc33 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:52.957086 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-3c8056e2-5b01-44c1-8c9c-c07e7d4ff680 req-07b58900-68b4-47b6-8248-5ee15acdcc33 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:52.975761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-3c8056e2-5b01-44c1-8c9c-c07e7d4ff680 req-07b58900-68b4-47b6-8248-5ee15acdcc33 service nova] Creating event network-vif-deleted:10521465-8839-40ca-b38b-0742f4477643 for instance 64981f66-63e8-4a97-8692-87aa75b7ac79 on hv-cinder-84949 Jul 18 10:57:52.984040 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-3c8056e2-5b01-44c1-8c9c-c07e7d4ff680 req-07b58900-68b4-47b6-8248-5ee15acdcc33 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218926 Jul 18 10:57:52.985127 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 554/1079] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:57:53.018585 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-23bec5e8-b0a9-4d6f-aac8-8515c64bcf63 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:53.019980 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-23bec5e8-b0a9-4d6f-aac8-8515c64bcf63 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:53.029028 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-23bec5e8-b0a9-4d6f-aac8-8515c64bcf63 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:53.029476 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-23bec5e8-b0a9-4d6f-aac8-8515c64bcf63 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:53.030564 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-23bec5e8-b0a9-4d6f-aac8-8515c64bcf63 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:53.031036 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-23bec5e8-b0a9-4d6f-aac8-8515c64bcf63 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:53.251667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-23bec5e8-b0a9-4d6f-aac8-8515c64bcf63 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:53.263187 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-23bec5e8-b0a9-4d6f-aac8-8515c64bcf63 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.253837 Jul 18 10:57:53.263869 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 526/1080] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:53 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:53.674259 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-7ebd4291-3a76-406a-9154-102d11397192 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:53.675065 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-7ebd4291-3a76-406a-9154-102d11397192 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:53.684468 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ebd4291-3a76-406a-9154-102d11397192 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:53.685171 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ebd4291-3a76-406a-9154-102d11397192 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:53.686587 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ebd4291-3a76-406a-9154-102d11397192 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:53.687365 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ebd4291-3a76-406a-9154-102d11397192 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:53.723850 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ebd4291-3a76-406a-9154-102d11397192 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:53.724304 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7ebd4291-3a76-406a-9154-102d11397192 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:53.724762 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-7ebd4291-3a76-406a-9154-102d11397192 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lazy-loading 'fault' on Instance uuid 64981f66-63e8-4a97-8692-87aa75b7ac79 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:57:53.775866 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7ebd4291-3a76-406a-9154-102d11397192 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:53.786168 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-7ebd4291-3a76-406a-9154-102d11397192 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 200 len: 1309 microversion: 2.1 time: 0.116628 Jul 18 10:57:53.787070 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 555/1081] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:53 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 1309 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:54.288071 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-4b888a90-decf-4721-b4e4-7b2342944d8c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:54.290443 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-4b888a90-decf-4721-b4e4-7b2342944d8c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:54.297201 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4b888a90-decf-4721-b4e4-7b2342944d8c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:54.297657 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4b888a90-decf-4721-b4e4-7b2342944d8c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:54.298440 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4b888a90-decf-4721-b4e4-7b2342944d8c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:54.298880 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4b888a90-decf-4721-b4e4-7b2342944d8c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:54.467573 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4b888a90-decf-4721-b4e4-7b2342944d8c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:54.475801 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-4b888a90-decf-4721-b4e4-7b2342944d8c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.191945 Jul 18 10:57:54.476414 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 527/1082] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:54 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:54.805866 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-fd257ea7-6c40-4f53-9a98-f4deec7c5225 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:54.806499 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-fd257ea7-6c40-4f53-9a98-f4deec7c5225 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 64981f66-63e8-4a97-8692-87aa75b7ac79] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:54.814365 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fd257ea7-6c40-4f53-9a98-f4deec7c5225 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:54.814743 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fd257ea7-6c40-4f53-9a98-f4deec7c5225 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:54.815524 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fd257ea7-6c40-4f53-9a98-f4deec7c5225 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:54.815967 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-fd257ea7-6c40-4f53-9a98-f4deec7c5225 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:54.831356 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-fd257ea7-6c40-4f53-9a98-f4deec7c5225 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] HTTP exception thrown: Instance 64981f66-63e8-4a97-8692-87aa75b7ac79 could not be found. Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-fd257ea7-6c40-4f53-9a98-f4deec7c5225 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Request method failure captured: Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 HTTP/1.1 Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1TxmrkwbWKp2Xp0Dq0VqDEYNgI3z9cCVfUFeviPzzVmkXSlAwmeDboWU2E1weHgwa6DI8jKuVHgI-sQ3SwB8FLbhwNrNVq8kVy66-mQGQNNaGV1tHNzyPC3Ddg5L79PDGp1zFiXqqpDTcC9NsIDTwUDrwXE1S6imNKzEK9BAqgQ1ttk Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: bf3f09bf74324f7ca7268feb67c046f8 Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2076963517 Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:57:54.833087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:57:54.835417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bf3f09bf74324f7ca7268feb67c046f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bf3f09bf74324f7ca7268feb67c046f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bf3f09bf74324f7ca7268feb67c046f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bf3f09bf74324f7ca7268feb67c046f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:57:54.835417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-VolumesSnapshotTestJSON-2076963517 Jul 18 10:57:54.835417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: bf3f09bf74324f7ca7268feb67c046f8 Jul 18 10:57:54.835417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2076963517 Jul 18 10:57:54.835417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-VolumesSnapshotTestJSON-2076963517-project Jul 18 10:57:54.835417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:57:54.835417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:57:54.835417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: d612283280884f119b50cceae973a6ec Jul 18 10:57:54.835417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-VolumesSnapshotTestJSON-2076963517-project Jul 18 10:57:54.835417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:57:54.835417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 64981f66-63e8-4a97-8692-87aa75b7ac79 could not be found. Jul 18 10:57:54.835417 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '64981f66-63e8-4a97-8692-87aa75b7ac79'} Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64981f66-63e8-4a97-8692-87aa75b7ac79 could not be found. Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:57:54.836659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64981f66-63e8-4a97-8692-87aa75b7ac79 could not be found. Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64981f66-63e8-4a97-8692-87aa75b7ac79 could not be found. Jul 18 10:57:54.841769 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:57:54.843234 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-fd257ea7-6c40-4f53-9a98-f4deec7c5225 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Returning 404 to user: Instance 64981f66-63e8-4a97-8692-87aa75b7ac79 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:57:54.843234 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-fd257ea7-6c40-4f53-9a98-f4deec7c5225 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79" status: 404 len: 111 microversion: 2.1 time: 0.032560 Jul 18 10:57:54.843234 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 556/1083] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:54 2022] GET /compute/v2.1/servers/64981f66-63e8-4a97-8692-87aa75b7ac79 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:57:55.494037 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d52e4277-92dc-4e57-b807-5b3024f5fd2c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:55.495128 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d52e4277-92dc-4e57-b807-5b3024f5fd2c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:55.503282 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d52e4277-92dc-4e57-b807-5b3024f5fd2c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:55.504089 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d52e4277-92dc-4e57-b807-5b3024f5fd2c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:55.505312 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d52e4277-92dc-4e57-b807-5b3024f5fd2c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:55.506039 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d52e4277-92dc-4e57-b807-5b3024f5fd2c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:55.763844 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-d52e4277-92dc-4e57-b807-5b3024f5fd2c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:55.774082 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d52e4277-92dc-4e57-b807-5b3024f5fd2c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1358 microversion: 2.1 time: 0.284022 Jul 18 10:57:55.774837 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 528/1084] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:55 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:56.559685 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4c67c88b-67f9-4029-a5bc-3318ca12a3f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:56.560429 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-4c67c88b-67f9-4029-a5bc-3318ca12a3f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:56.565023 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-5d90f7b2-2d4e-49fc-8e5b-8eaf7be17361 req-6712bc2f-f668-49e7-9705-f61ddc215814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e75fba7-e72d-4479-ab36-0bbf9f294d22", "tag": "42168f45-7a03-471a-b163-85fef4b32faa"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:56.567437 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4c67c88b-67f9-4029-a5bc-3318ca12a3f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:56.567908 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4c67c88b-67f9-4029-a5bc-3318ca12a3f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:56.568971 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4c67c88b-67f9-4029-a5bc-3318ca12a3f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:56.569429 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4c67c88b-67f9-4029-a5bc-3318ca12a3f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:56.574887 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:56.586489 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-5d90f7b2-2d4e-49fc-8e5b-8eaf7be17361 req-6712bc2f-f668-49e7-9705-f61ddc215814 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:56.592193 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-5d90f7b2-2d4e-49fc-8e5b-8eaf7be17361 req-6712bc2f-f668-49e7-9705-f61ddc215814 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:56.602521 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-4c67c88b-67f9-4029-a5bc-3318ca12a3f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Going to try to terminate instance {{(pid=125007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:57:56.609943 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-5d90f7b2-2d4e-49fc-8e5b-8eaf7be17361 req-6712bc2f-f668-49e7-9705-f61ddc215814 service nova] Creating event network-changed:42168f45-7a03-471a-b163-85fef4b32faa for instance 6e75fba7-e72d-4479-ab36-0bbf9f294d22 on hv-cinder-84949 Jul 18 10:57:56.618896 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-5d90f7b2-2d4e-49fc-8e5b-8eaf7be17361 req-6712bc2f-f668-49e7-9705-f61ddc215814 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060768 Jul 18 10:57:56.620126 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 529/1085] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:57:56.798660 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-6e207dd1-3ee1-4e7a-8fe8-5a88a25defc5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:56.799604 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-6e207dd1-3ee1-4e7a-8fe8-5a88a25defc5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:56.807699 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e207dd1-3ee1-4e7a-8fe8-5a88a25defc5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:56.810438 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e207dd1-3ee1-4e7a-8fe8-5a88a25defc5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:56.811365 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e207dd1-3ee1-4e7a-8fe8-5a88a25defc5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:56.811951 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-6e207dd1-3ee1-4e7a-8fe8-5a88a25defc5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:56.925455 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4c67c88b-67f9-4029-a5bc-3318ca12a3f0 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 204 len: 0 microversion: 2.1 time: 0.369120 Jul 18 10:57:56.933414 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 557/1086] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:57:56 2022] DELETE /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:57:56.942830 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-1fbd49c5-2d73-4065-8d26-033fc1b4c879 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:56.944547 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-1fbd49c5-2d73-4065-8d26-033fc1b4c879 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:56.955643 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1fbd49c5-2d73-4065-8d26-033fc1b4c879 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:56.956905 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1fbd49c5-2d73-4065-8d26-033fc1b4c879 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:56.958346 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1fbd49c5-2d73-4065-8d26-033fc1b4c879 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:56.959515 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-1fbd49c5-2d73-4065-8d26-033fc1b4c879 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:56.994897 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-6e207dd1-3ee1-4e7a-8fe8-5a88a25defc5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:57.003888 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-6e207dd1-3ee1-4e7a-8fe8-5a88a25defc5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1549 microversion: 2.1 time: 0.209654 Jul 18 10:57:57.004978 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 530/1087] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:56 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1549 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:57.032097 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c628d2b2-c491-4ac5-aa19-aa620d7e584c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:57.033761 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c628d2b2-c491-4ac5-aa19-aa620d7e584c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:57.044583 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c628d2b2-c491-4ac5-aa19-aa620d7e584c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:57.045751 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c628d2b2-c491-4ac5-aa19-aa620d7e584c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:57.049129 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c628d2b2-c491-4ac5-aa19-aa620d7e584c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:57.049129 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c628d2b2-c491-4ac5-aa19-aa620d7e584c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:57.256325 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-1fbd49c5-2d73-4065-8d26-033fc1b4c879 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:57.270473 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-1fbd49c5-2d73-4065-8d26-033fc1b4c879 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1577 microversion: 2.1 time: 0.335905 Jul 18 10:57:57.273907 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 558/1088] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:56 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1577 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:57:57.297869 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c628d2b2-c491-4ac5-aa19-aa620d7e584c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:57.306720 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c628d2b2-c491-4ac5-aa19-aa620d7e584c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1549 microversion: 2.1 time: 0.282367 Jul 18 10:57:57.307295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 531/1089] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:57 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1549 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:57.327553 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-da1984cf-6785-4230-99da-b27b072a8f4e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:57.331581 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-da1984cf-6785-4230-99da-b27b072a8f4e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:57.332229 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-da1984cf-6785-4230-99da-b27b072a8f4e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Searching by: {'deleted': False, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb'} {{(pid=125007) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 10:57:57.340999 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-da1984cf-6785-4230-99da-b27b072a8f4e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:57.341760 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-da1984cf-6785-4230-99da-b27b072a8f4e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:57.342600 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-da1984cf-6785-4230-99da-b27b072a8f4e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:57.343040 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-da1984cf-6785-4230-99da-b27b072a8f4e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:57.464056 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.multi_cell_list [None req-da1984cf-6785-4230-99da-b27b072a8f4e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125007) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 10:57:57.580051 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-da1984cf-6785-4230-99da-b27b072a8f4e tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.257419 Jul 18 10:57:57.581033 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 559/1090] 10.222.0.49 () {58 vars in 1124 bytes} [Mon Jul 18 10:57:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:57:57.592310 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-1d0671e8-b9f1-4e6f-927f-7ef9fbf604fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:57.593042 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-1d0671e8-b9f1-4e6f-927f-7ef9fbf604fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:57.600384 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1d0671e8-b9f1-4e6f-927f-7ef9fbf604fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:57.600994 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1d0671e8-b9f1-4e6f-927f-7ef9fbf604fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:57.601851 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1d0671e8-b9f1-4e6f-927f-7ef9fbf604fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:57.602373 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1d0671e8-b9f1-4e6f-927f-7ef9fbf604fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:57.788395 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-1d0671e8-b9f1-4e6f-927f-7ef9fbf604fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:57.800893 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-1d0671e8-b9f1-4e6f-927f-7ef9fbf604fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1549 microversion: 2.1 time: 0.213210 Jul 18 10:57:57.801501 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 532/1091] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:57 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1549 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:58.296950 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-879c0456-2a40-4450-9539-3efbec1810f6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:58.297589 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-879c0456-2a40-4450-9539-3efbec1810f6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:58.300702 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:58.309659 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-879c0456-2a40-4450-9539-3efbec1810f6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:58.310147 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-879c0456-2a40-4450-9539-3efbec1810f6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:58.311108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-879c0456-2a40-4450-9539-3efbec1810f6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:58.311686 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-879c0456-2a40-4450-9539-3efbec1810f6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:58.517488 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-879c0456-2a40-4450-9539-3efbec1810f6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:58.528501 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-879c0456-2a40-4450-9539-3efbec1810f6 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1577 microversion: 2.1 time: 0.237598 Jul 18 10:57:58.529216 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 560/1092] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:58 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1577 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:59.548833 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-89eb1580-13e2-4a21-bbfd-e2348a4f5de9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:59.549600 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-89eb1580-13e2-4a21-bbfd-e2348a4f5de9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:59.556663 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89eb1580-13e2-4a21-bbfd-e2348a4f5de9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:59.557229 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89eb1580-13e2-4a21-bbfd-e2348a4f5de9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:59.558061 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89eb1580-13e2-4a21-bbfd-e2348a4f5de9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:59.558599 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-89eb1580-13e2-4a21-bbfd-e2348a4f5de9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:59.769865 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-89eb1580-13e2-4a21-bbfd-e2348a4f5de9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:59.783857 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-89eb1580-13e2-4a21-bbfd-e2348a4f5de9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1577 microversion: 2.1 time: 0.238731 Jul 18 10:57:59.785181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 533/1093] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:59 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1577 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:00.067109 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-941022e4-ae0f-4fe4-af22-97c5d86833ec tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2820a3e1-5739-4501-a120-0a67aa5b2e87"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:58:00.068906 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-941022e4-ae0f-4fe4-af22-97c5d86833ec tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:00.076911 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-941022e4-ae0f-4fe4-af22-97c5d86833ec tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:00.077395 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-941022e4-ae0f-4fe4-af22-97c5d86833ec tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:00.078192 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-941022e4-ae0f-4fe4-af22-97c5d86833ec tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:00.078830 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-941022e4-ae0f-4fe4-af22-97c5d86833ec tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:00.813406 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c2e804d6-9560-4154-beef-4f4965fc41e7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:00.814777 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c2e804d6-9560-4154-beef-4f4965fc41e7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:00.824050 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c2e804d6-9560-4154-beef-4f4965fc41e7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:00.824752 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c2e804d6-9560-4154-beef-4f4965fc41e7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:00.825896 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c2e804d6-9560-4154-beef-4f4965fc41e7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:00.826551 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c2e804d6-9560-4154-beef-4f4965fc41e7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:01.090957 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c2e804d6-9560-4154-beef-4f4965fc41e7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:01.106977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c2e804d6-9560-4154-beef-4f4965fc41e7 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1459 microversion: 2.1 time: 0.300245 Jul 18 10:58:01.108646 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 534/1094] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:00 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1459 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:58:01.249984 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-941022e4-ae0f-4fe4-af22-97c5d86833ec tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "POST /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.187120 Jul 18 10:58:01.251384 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 561/1095] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 18 10:58:00 2022] POST /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments => generated 194 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:58:01.419841 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-5d50b445-5f13-4aec-9595-06f3d738fe3d req-885afcd4-7001-40dc-971a-02718c9606f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e75fba7-e72d-4479-ab36-0bbf9f294d22", "name": "network-vif-deleted", "tag": "42168f45-7a03-471a-b163-85fef4b32faa"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:58:01.428553 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-5d50b445-5f13-4aec-9595-06f3d738fe3d req-885afcd4-7001-40dc-971a-02718c9606f7 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:01.429176 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-5d50b445-5f13-4aec-9595-06f3d738fe3d req-885afcd4-7001-40dc-971a-02718c9606f7 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:01.441861 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-5d50b445-5f13-4aec-9595-06f3d738fe3d req-885afcd4-7001-40dc-971a-02718c9606f7 service nova] Creating event network-vif-deleted:42168f45-7a03-471a-b163-85fef4b32faa for instance 6e75fba7-e72d-4479-ab36-0bbf9f294d22 on hv-cinder-84949 Jul 18 10:58:01.447204 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-5d50b445-5f13-4aec-9595-06f3d738fe3d req-885afcd4-7001-40dc-971a-02718c9606f7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101884 Jul 18 10:58:01.448594 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 535/1096] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:58:02.133797 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-bc566b40-d6e4-4d45-b4ab-eb91c5666933 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:02.134539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-bc566b40-d6e4-4d45-b4ab-eb91c5666933 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:02.142171 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bc566b40-d6e4-4d45-b4ab-eb91c5666933 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:02.142621 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bc566b40-d6e4-4d45-b4ab-eb91c5666933 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:02.143398 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bc566b40-d6e4-4d45-b4ab-eb91c5666933 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:02.143837 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-bc566b40-d6e4-4d45-b4ab-eb91c5666933 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:02.216283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-bc566b40-d6e4-4d45-b4ab-eb91c5666933 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:02.230163 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-bc566b40-d6e4-4d45-b4ab-eb91c5666933 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1226 microversion: 2.1 time: 0.100716 Jul 18 10:58:02.231225 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 562/1097] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:02 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:03.249111 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f7c9bd75-dcdc-4ac2-a261-09c91f74afc9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:03.249742 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f7c9bd75-dcdc-4ac2-a261-09c91f74afc9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:03.257090 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f7c9bd75-dcdc-4ac2-a261-09c91f74afc9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:03.257543 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f7c9bd75-dcdc-4ac2-a261-09c91f74afc9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:03.258333 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f7c9bd75-dcdc-4ac2-a261-09c91f74afc9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:03.258791 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f7c9bd75-dcdc-4ac2-a261-09c91f74afc9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:03.294475 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f7c9bd75-dcdc-4ac2-a261-09c91f74afc9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:03.294712 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f7c9bd75-dcdc-4ac2-a261-09c91f74afc9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:03.295099 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-f7c9bd75-dcdc-4ac2-a261-09c91f74afc9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lazy-loading 'fault' on Instance uuid 6e75fba7-e72d-4479-ab36-0bbf9f294d22 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:58:03.342866 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f7c9bd75-dcdc-4ac2-a261-09c91f74afc9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:03.351181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f7c9bd75-dcdc-4ac2-a261-09c91f74afc9 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1231 microversion: 2.1 time: 0.107013 Jul 18 10:58:03.351765 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 536/1098] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:03 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1231 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:58:04.370014 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-41e21b99-2779-477d-888d-0a5679217467 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:04.371331 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-41e21b99-2779-477d-888d-0a5679217467 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:04.378936 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-41e21b99-2779-477d-888d-0a5679217467 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:04.379392 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-41e21b99-2779-477d-888d-0a5679217467 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:04.380215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-41e21b99-2779-477d-888d-0a5679217467 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:04.380656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-41e21b99-2779-477d-888d-0a5679217467 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:04.416441 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-41e21b99-2779-477d-888d-0a5679217467 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:04.416998 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-41e21b99-2779-477d-888d-0a5679217467 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:04.418487 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-41e21b99-2779-477d-888d-0a5679217467 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lazy-loading 'fault' on Instance uuid 6e75fba7-e72d-4479-ab36-0bbf9f294d22 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:58:04.469256 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-41e21b99-2779-477d-888d-0a5679217467 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:04.477713 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-41e21b99-2779-477d-888d-0a5679217467 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1231 microversion: 2.1 time: 0.111696 Jul 18 10:58:04.478304 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 563/1099] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:04 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1231 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:58:05.265206 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-136498371", "imageRef": "25b14448-eeb0-480d-99b3-1012c0c1b71f", "flavorRef": "452", "networks": [{"uuid": "4d3b5885-0cea-4000-b7c7-cf07ce205b79"}]}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:58:05.328655 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.network.neutron [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] validate_networks() for [('4d3b5885-0cea-4000-b7c7-cf07ce205b79', None, None, None, None, None)] {{(pid=125005) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:58:05.496871 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4d9acc6e-0fa9-46ce-bf36-bc15e88cea55 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:05.497645 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-4d9acc6e-0fa9-46ce-bf36-bc15e88cea55 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:05.507759 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4d9acc6e-0fa9-46ce-bf36-bc15e88cea55 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:05.508339 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4d9acc6e-0fa9-46ce-bf36-bc15e88cea55 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:05.509467 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4d9acc6e-0fa9-46ce-bf36-bc15e88cea55 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:05.509939 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4d9acc6e-0fa9-46ce-bf36-bc15e88cea55 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:05.553166 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4d9acc6e-0fa9-46ce-bf36-bc15e88cea55 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:05.553539 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4d9acc6e-0fa9-46ce-bf36-bc15e88cea55 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:05.554232 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.objects.instance [None req-4d9acc6e-0fa9-46ce-bf36-bc15e88cea55 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lazy-loading 'fault' on Instance uuid 6e75fba7-e72d-4479-ab36-0bbf9f294d22 {{(pid=125007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:58:05.557583 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:58:05.617878 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-4d9acc6e-0fa9-46ce-bf36-bc15e88cea55 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb483b1aee944da8910dd7468a0ef4ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f436162f3a4bd4b3a94f584e7d8782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:05.628451 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4d9acc6e-0fa9-46ce-bf36-bc15e88cea55 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 200 len: 1185 microversion: 2.1 time: 0.136005 Jul 18 10:58:05.628998 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 564/1100] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:05 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 1185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:05.815908 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Flavor limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:58:05.816377 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Image limits 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:58:05.816926 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Flavor pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:58:05.817341 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Image pref 0:0:0 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:58:05.817754 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.virt.hardware [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125005) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:58:05.828913 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:05.829369 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:05.830174 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:05.830730 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:05.850874 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Getting quotas for project bf3f09bf74324f7ca7268feb67c046f8. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:58:05.856393 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.quota [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Getting quotas for user d612283280884f119b50cceae973a6ec and project bf3f09bf74324f7ca7268feb67c046f8. Resources: {'instances', 'ram', 'cores'} {{(pid=125005) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:58:05.871468 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Going to run 1 instances... {{(pid=125005) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:58:05.874198 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25b14448-eeb0-480d-99b3-1012c0c1b71f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125005) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:58:06.053385 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-1356b8fd-c5c2-41ff-b2b0-5083e66fc454 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792016 Jul 18 10:58:06.054028 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 537/1101] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 18 10:58:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:58:06.071592 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ca7f32a8-10fa-42c5-8f79-d60a3c867b42 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:06.071592 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ca7f32a8-10fa-42c5-8f79-d60a3c867b42 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:06.158565 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-ca7f32a8-10fa-42c5-8f79-d60a3c867b42 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:06.168042 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ca7f32a8-10fa-42c5-8f79-d60a3c867b42 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1218 microversion: 2.1 time: 0.105755 Jul 18 10:58:06.168756 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 565/1102] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:06 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:58:06.648347 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7d9f0c2b-c498-44ae-90c2-d756d92a58f2 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:06.649221 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-7d9f0c2b-c498-44ae-90c2-d756d92a58f2 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 6e75fba7-e72d-4479-ab36-0bbf9f294d22] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:06.659715 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7d9f0c2b-c498-44ae-90c2-d756d92a58f2 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:06.663949 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7d9f0c2b-c498-44ae-90c2-d756d92a58f2 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:06.663949 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7d9f0c2b-c498-44ae-90c2-d756d92a58f2 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:06.663949 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-7d9f0c2b-c498-44ae-90c2-d756d92a58f2 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:06.694653 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-7d9f0c2b-c498-44ae-90c2-d756d92a58f2 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] HTTP exception thrown: Instance 6e75fba7-e72d-4479-ab36-0bbf9f294d22 could not be found. Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7d9f0c2b-c498-44ae-90c2-d756d92a58f2 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Request method failure captured: Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 HTTP/1.1 Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1Tq9mlAHK0ystMhjyDb0YyO8U2hK7gGU1fUhDRpNQDWPyz-rISX1S04lsJPqJLD5MjfYJBjOs8RlHr0wD6AJXubnX1mFbTfY8w7JMXJAbxIlkuXby8pM0wO-ulmU3SBPUTAYPBrSsx5HpuARfVCkkhZFj-KX7C7-wHeLOUnh1eAJWYY Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 17f436162f3a4bd4b3a94f584e7d8782 Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-TestVolumeBootPattern-497016436 Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:58:06.696313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:58:06.699110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:58:06.699110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-TestVolumeBootPattern-497016436 Jul 18 10:58:06.699110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 17f436162f3a4bd4b3a94f584e7d8782 Jul 18 10:58:06.699110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-TestVolumeBootPattern-497016436 Jul 18 10:58:06.699110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-TestVolumeBootPattern-497016436-project Jul 18 10:58:06.699110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:58:06.699110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:58:06.699110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: eb483b1aee944da8910dd7468a0ef4ac Jul 18 10:58:06.699110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-TestVolumeBootPattern-497016436-project Jul 18 10:58:06.699110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:58:06.699110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 6e75fba7-e72d-4479-ab36-0bbf9f294d22 could not be found. Jul 18 10:58:06.699110 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '6e75fba7-e72d-4479-ab36-0bbf9f294d22'} Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e75fba7-e72d-4479-ab36-0bbf9f294d22 could not be found. Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:58:06.700532 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e75fba7-e72d-4479-ab36-0bbf9f294d22 could not be found. Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e75fba7-e72d-4479-ab36-0bbf9f294d22 could not be found. Jul 18 10:58:06.703181 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:58:06.721108 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-7d9f0c2b-c498-44ae-90c2-d756d92a58f2 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Returning 404 to user: Instance 6e75fba7-e72d-4479-ab36-0bbf9f294d22 could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:58:06.721108 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-7d9f0c2b-c498-44ae-90c2-d756d92a58f2 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22" status: 404 len: 111 microversion: 2.1 time: 0.055145 Jul 18 10:58:06.721108 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 538/1103] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:06 2022] GET /compute/v2.1/servers/6e75fba7-e72d-4479-ab36-0bbf9f294d22 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:58:07.190055 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-13e614d5-822c-4f97-adcb-512236583c60 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:07.190699 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-13e614d5-822c-4f97-adcb-512236583c60 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:07.197733 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-13e614d5-822c-4f97-adcb-512236583c60 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:07.198186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-13e614d5-822c-4f97-adcb-512236583c60 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:07.199557 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-13e614d5-822c-4f97-adcb-512236583c60 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:07.199995 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-13e614d5-822c-4f97-adcb-512236583c60 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:07.279994 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-13e614d5-822c-4f97-adcb-512236583c60 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:07.287317 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-13e614d5-822c-4f97-adcb-512236583c60 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1222 microversion: 2.1 time: 0.101453 Jul 18 10:58:07.288283 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 566/1104] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:07 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:58:07.370068 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-025a1d7f-89f5-43d1-b0c2-3918c66918d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:07.371883 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-025a1d7f-89f5-43d1-b0c2-3918c66918d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:07.377901 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-025a1d7f-89f5-43d1-b0c2-3918c66918d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:07.378362 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-025a1d7f-89f5-43d1-b0c2-3918c66918d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:07.379136 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-025a1d7f-89f5-43d1-b0c2-3918c66918d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:07.379573 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-025a1d7f-89f5-43d1-b0c2-3918c66918d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:07.394420 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-025a1d7f-89f5-43d1-b0c2-3918c66918d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] HTTP exception thrown: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-025a1d7f-89f5-43d1-b0c2-3918c66918d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Request method failure captured: Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: DELETE /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c HTTP/1.1 Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1Tq9mlAHK0ystMhjyDb0YyO8U2hK7gGU1fUhDRpNQDWPyz-rISX1S04lsJPqJLD5MjfYJBjOs8RlHr0wD6AJXubnX1mFbTfY8w7JMXJAbxIlkuXby8pM0wO-ulmU3SBPUTAYPBrSsx5HpuARfVCkkhZFj-KX7C7-wHeLOUnh1eAJWYY Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: 17f436162f3a4bd4b3a94f584e7d8782 Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-TestVolumeBootPattern-497016436 Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:58:07.397284 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:58:07.399229 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:58:07.399229 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-TestVolumeBootPattern-497016436 Jul 18 10:58:07.399229 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: 17f436162f3a4bd4b3a94f584e7d8782 Jul 18 10:58:07.399229 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-TestVolumeBootPattern-497016436 Jul 18 10:58:07.399229 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-TestVolumeBootPattern-497016436-project Jul 18 10:58:07.399229 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:58:07.399229 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:58:07.399229 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: eb483b1aee944da8910dd7468a0ef4ac Jul 18 10:58:07.399229 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-TestVolumeBootPattern-497016436-project Jul 18 10:58:07.399229 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:58:07.399229 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. Jul 18 10:58:07.399229 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'id': '309e30be-b4c2-4959-97f8-1ea7925c9e5c'} Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:58:07.400549 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. Jul 18 10:58:07.403389 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:58:07.405632 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-025a1d7f-89f5-43d1-b0c2-3918c66918d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Returning 404 to user: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:58:07.405632 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-025a1d7f-89f5-43d1-b0c2-3918c66918d8 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "DELETE /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 404 len: 111 microversion: 2.1 time: 0.031493 Jul 18 10:58:07.405632 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 539/1105] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:58:07 2022] DELETE /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:58:07.407644 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5104fbe4-9db8-4895-844f-3b952af9fb83 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:07.408299 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-5104fbe4-9db8-4895-844f-3b952af9fb83 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] [instance: 309e30be-b4c2-4959-97f8-1ea7925c9e5c] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:07.410407 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=2 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:58:07.417384 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5104fbe4-9db8-4895-844f-3b952af9fb83 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:07.419190 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5104fbe4-9db8-4895-844f-3b952af9fb83 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:07.420125 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5104fbe4-9db8-4895-844f-3b952af9fb83 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:07.421687 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-5104fbe4-9db8-4895-844f-3b952af9fb83 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:07.440075 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-5104fbe4-9db8-4895-844f-3b952af9fb83 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] HTTP exception thrown: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5104fbe4-9db8-4895-844f-3b952af9fb83 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Request method failure captured: Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c HTTP/1.1 Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1Tq9mlAHK0ystMhjyDb0YyO8U2hK7gGU1fUhDRpNQDWPyz-rISX1S04lsJPqJLD5MjfYJBjOs8RlHr0wD6AJXubnX1mFbTfY8w7JMXJAbxIlkuXby8pM0wO-ulmU3SBPUTAYPBrSsx5HpuARfVCkkhZFj-KX7C7-wHeLOUnh1eAJWYY Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: 17f436162f3a4bd4b3a94f584e7d8782 Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-TestVolumeBootPattern-497016436 Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:58:07.441796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:58:07.443561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/17f436162f3a4bd4b3a94f584e7d8782"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:58:07.443561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-TestVolumeBootPattern-497016436 Jul 18 10:58:07.443561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: 17f436162f3a4bd4b3a94f584e7d8782 Jul 18 10:58:07.443561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-TestVolumeBootPattern-497016436 Jul 18 10:58:07.443561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-TestVolumeBootPattern-497016436-project Jul 18 10:58:07.443561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:58:07.443561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:58:07.443561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: eb483b1aee944da8910dd7468a0ef4ac Jul 18 10:58:07.443561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-TestVolumeBootPattern-497016436-project Jul 18 10:58:07.443561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:58:07.443561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. Jul 18 10:58:07.443561 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '309e30be-b4c2-4959-97f8-1ea7925c9e5c'} Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:58:07.445108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. Jul 18 10:58:07.452347 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:58:07.454971 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-5104fbe4-9db8-4895-844f-3b952af9fb83 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Returning 404 to user: Instance 309e30be-b4c2-4959-97f8-1ea7925c9e5c could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:58:07.454971 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-5104fbe4-9db8-4895-844f-3b952af9fb83 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c" status: 404 len: 111 microversion: 2.1 time: 0.039796 Jul 18 10:58:07.454971 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 567/1106] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:07 2022] GET /compute/v2.1/servers/309e30be-b4c2-4959-97f8-1ea7925c9e5c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:58:08.306430 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-46d85a14-c3c4-4e49-a94f-536445358174 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:08.307096 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-46d85a14-c3c4-4e49-a94f-536445358174 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:08.314496 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-46d85a14-c3c4-4e49-a94f-536445358174 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:08.314949 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-46d85a14-c3c4-4e49-a94f-536445358174 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:08.315738 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-46d85a14-c3c4-4e49-a94f-536445358174 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:08.316176 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-46d85a14-c3c4-4e49-a94f-536445358174 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:08.406108 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-46d85a14-c3c4-4e49-a94f-536445358174 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:08.413990 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-46d85a14-c3c4-4e49-a94f-536445358174 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1270 microversion: 2.1 time: 0.111596 Jul 18 10:58:08.415011 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 540/1107] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:08 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:58:09.173303 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e87295e0-2706-4368-bac1-6ef88b0be543 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] Calling method '.version_select at 0x7f636502bd30>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:09.294170 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e87295e0-2706-4368-bac1-6ef88b0be543 tempest-TestVolumeBootPattern-497016436 tempest-TestVolumeBootPattern-497016436-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1612637408" status: 202 len: 0 microversion: 2.1 time: 0.129176 Jul 18 10:58:09.295174 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 568/1108] 10.222.0.49 () {58 vars in 1262 bytes} [Mon Jul 18 10:58:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1612637408 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:58:09.440714 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f7ff5605-a8d7-478a-8c26-89b2f03a2604 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:09.441599 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f7ff5605-a8d7-478a-8c26-89b2f03a2604 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:09.453624 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f7ff5605-a8d7-478a-8c26-89b2f03a2604 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:09.454405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f7ff5605-a8d7-478a-8c26-89b2f03a2604 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:09.455801 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f7ff5605-a8d7-478a-8c26-89b2f03a2604 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:09.456589 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f7ff5605-a8d7-478a-8c26-89b2f03a2604 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:09.724814 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-f7ff5605-a8d7-478a-8c26-89b2f03a2604 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:09.739629 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f7ff5605-a8d7-478a-8c26-89b2f03a2604 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1318 microversion: 2.1 time: 0.307901 Jul 18 10:58:09.744048 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 541/1109] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:09 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:10.772553 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8eae63f0-3d5b-4248-926b-6656779b567a tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:10.774780 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-8eae63f0-3d5b-4248-926b-6656779b567a tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:10.789974 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8eae63f0-3d5b-4248-926b-6656779b567a tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:10.791205 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8eae63f0-3d5b-4248-926b-6656779b567a tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:10.793475 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8eae63f0-3d5b-4248-926b-6656779b567a tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:10.794266 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8eae63f0-3d5b-4248-926b-6656779b567a tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:10.832709 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-1287d49d-7a7f-4955-adac-b8cba215a3b3 req-1d665a93-f42d-4202-9f2f-519bc5ddbc53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f208141-cbfc-4236-ae8e-c665ea4d8c16", "tag": "b742f0a4-6f8f-4634-b68b-2feaf81467aa"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:58:10.859647 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-1287d49d-7a7f-4955-adac-b8cba215a3b3 req-1d665a93-f42d-4202-9f2f-519bc5ddbc53 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:10.860130 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-1287d49d-7a7f-4955-adac-b8cba215a3b3 req-1d665a93-f42d-4202-9f2f-519bc5ddbc53 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:10.880960 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-1287d49d-7a7f-4955-adac-b8cba215a3b3 req-1d665a93-f42d-4202-9f2f-519bc5ddbc53 service nova] Creating event network-changed:b742f0a4-6f8f-4634-b68b-2feaf81467aa for instance 8f208141-cbfc-4236-ae8e-c665ea4d8c16 on hv-cinder-84949 Jul 18 10:58:10.889835 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-1287d49d-7a7f-4955-adac-b8cba215a3b3 req-1d665a93-f42d-4202-9f2f-519bc5ddbc53 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065684 Jul 18 10:58:10.891189 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 542/1110] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:58:11.005954 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-8eae63f0-3d5b-4248-926b-6656779b567a tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:11.015125 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-8eae63f0-3d5b-4248-926b-6656779b567a tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1318 microversion: 2.1 time: 0.258977 Jul 18 10:58:11.016122 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 569/1111] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:10 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:12.035726 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-103dc785-4b6b-4a6f-b24d-150cb2183947 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:12.036757 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-103dc785-4b6b-4a6f-b24d-150cb2183947 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:12.044296 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-103dc785-4b6b-4a6f-b24d-150cb2183947 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:12.045012 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-103dc785-4b6b-4a6f-b24d-150cb2183947 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:12.046167 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-103dc785-4b6b-4a6f-b24d-150cb2183947 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:12.046758 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-103dc785-4b6b-4a6f-b24d-150cb2183947 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:12.347144 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-103dc785-4b6b-4a6f-b24d-150cb2183947 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:12.365936 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-103dc785-4b6b-4a6f-b24d-150cb2183947 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1318 microversion: 2.1 time: 0.335289 Jul 18 10:58:12.380999 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 543/1112] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:12 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:12.418161 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-82511349-1dc0-465a-afa9-d9acb2b3267c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:12.419142 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-82511349-1dc0-465a-afa9-d9acb2b3267c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:12.428935 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-82511349-1dc0-465a-afa9-d9acb2b3267c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:12.428935 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-82511349-1dc0-465a-afa9-d9acb2b3267c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:12.431471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-82511349-1dc0-465a-afa9-d9acb2b3267c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:12.431471 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-82511349-1dc0-465a-afa9-d9acb2b3267c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:12.601396 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-82511349-1dc0-465a-afa9-d9acb2b3267c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:12.612692 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-82511349-1dc0-465a-afa9-d9acb2b3267c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1595 microversion: 2.1 time: 0.199051 Jul 18 10:58:12.613625 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 570/1113] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:12 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1595 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:13.394319 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-21406126-80c1-472e-a008-da626b06cf6f tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:13.395174 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-21406126-80c1-472e-a008-da626b06cf6f tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:13.402701 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-21406126-80c1-472e-a008-da626b06cf6f tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:13.403160 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-21406126-80c1-472e-a008-da626b06cf6f tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:13.403985 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-21406126-80c1-472e-a008-da626b06cf6f tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:13.404397 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-21406126-80c1-472e-a008-da626b06cf6f tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:13.639440 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-21406126-80c1-472e-a008-da626b06cf6f tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:13.657964 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-21406126-80c1-472e-a008-da626b06cf6f tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1318 microversion: 2.1 time: 0.267744 Jul 18 10:58:13.658521 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 544/1114] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:13 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:58:14.687847 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-af962eb5-b24d-4e58-9362-e2415f02f4a1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:14.689326 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-af962eb5-b24d-4e58-9362-e2415f02f4a1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:14.703038 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-af962eb5-b24d-4e58-9362-e2415f02f4a1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:14.704465 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-af962eb5-b24d-4e58-9362-e2415f02f4a1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:14.706826 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-af962eb5-b24d-4e58-9362-e2415f02f4a1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:14.708305 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-af962eb5-b24d-4e58-9362-e2415f02f4a1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:15.024423 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-af962eb5-b24d-4e58-9362-e2415f02f4a1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:15.033948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-af962eb5-b24d-4e58-9362-e2415f02f4a1 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1318 microversion: 2.1 time: 0.355203 Jul 18 10:58:15.044873 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 571/1115] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:14 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:15.486356 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-343110ec-7804-4328-a1e7-a071b03dadbc req-07b3e3dc-4f98-4d18-8cad-7efdcb2fa1fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d23cc92-a156-4a44-8b76-f082f7c3484a", "tag": "f9f873c9-64f4-4f0f-a61d-410318c37f4a"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:58:15.497690 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-343110ec-7804-4328-a1e7-a071b03dadbc req-07b3e3dc-4f98-4d18-8cad-7efdcb2fa1fa service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:15.498769 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-343110ec-7804-4328-a1e7-a071b03dadbc req-07b3e3dc-4f98-4d18-8cad-7efdcb2fa1fa service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:15.516506 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-343110ec-7804-4328-a1e7-a071b03dadbc req-07b3e3dc-4f98-4d18-8cad-7efdcb2fa1fa service nova] Creating event network-changed:f9f873c9-64f4-4f0f-a61d-410318c37f4a for instance 7d23cc92-a156-4a44-8b76-f082f7c3484a on hv-cinder-84949 Jul 18 10:58:15.523195 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-343110ec-7804-4328-a1e7-a071b03dadbc req-07b3e3dc-4f98-4d18-8cad-7efdcb2fa1fa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041056 Jul 18 10:58:15.524185 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 545/1116] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:58:16.052583 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-a0e45dcf-3ea7-42e5-8c4d-e0730f579e1d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:16.053210 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-a0e45dcf-3ea7-42e5-8c4d-e0730f579e1d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:16.060491 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0e45dcf-3ea7-42e5-8c4d-e0730f579e1d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:16.061262 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0e45dcf-3ea7-42e5-8c4d-e0730f579e1d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:16.062232 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0e45dcf-3ea7-42e5-8c4d-e0730f579e1d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:16.062965 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-a0e45dcf-3ea7-42e5-8c4d-e0730f579e1d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:16.163895 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell0:SELECT=2 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:58:16.400183 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-a0e45dcf-3ea7-42e5-8c4d-e0730f579e1d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:16.409211 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-a0e45dcf-3ea7-42e5-8c4d-e0730f579e1d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1318 microversion: 2.1 time: 0.360635 Jul 18 10:58:16.410559 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 572/1117] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:16 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:58:17.434560 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=2 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:58:17.443226 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell0:SELECT=6 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:58:17.443226 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3defe0e0-3b8d-4de7-9294-153e609fe900 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:17.444142 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3defe0e0-3b8d-4de7-9294-153e609fe900 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:17.452436 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3defe0e0-3b8d-4de7-9294-153e609fe900 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:17.453212 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3defe0e0-3b8d-4de7-9294-153e609fe900 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:17.454738 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3defe0e0-3b8d-4de7-9294-153e609fe900 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:17.456273 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3defe0e0-3b8d-4de7-9294-153e609fe900 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:17.521435 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=100 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:58:17.727981 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3defe0e0-3b8d-4de7-9294-153e609fe900 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:17.740059 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3defe0e0-3b8d-4de7-9294-153e609fe900 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1318 microversion: 2.1 time: 0.308105 Jul 18 10:58:17.752817 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 546/1118] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:17 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:17.848981 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-eb2c13a2-22c9-4a43-8559-b9da64ea4229 req-cc8e1a95-2b79-45c6-acf9-4f4fd82fff0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f208141-cbfc-4236-ae8e-c665ea4d8c16", "name": "network-vif-plugged", "status": "completed", "tag": "b742f0a4-6f8f-4634-b68b-2feaf81467aa"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:58:17.852215 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-eb2c13a2-22c9-4a43-8559-b9da64ea4229 req-cc8e1a95-2b79-45c6-acf9-4f4fd82fff0e service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:17.852707 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-eb2c13a2-22c9-4a43-8559-b9da64ea4229 req-cc8e1a95-2b79-45c6-acf9-4f4fd82fff0e service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:17.878629 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-eb2c13a2-22c9-4a43-8559-b9da64ea4229 req-cc8e1a95-2b79-45c6-acf9-4f4fd82fff0e service nova] Creating event network-vif-plugged:b742f0a4-6f8f-4634-b68b-2feaf81467aa for instance 8f208141-cbfc-4236-ae8e-c665ea4d8c16 on hv-cinder-84949 Jul 18 10:58:17.879848 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-eb2c13a2-22c9-4a43-8559-b9da64ea4229 req-cc8e1a95-2b79-45c6-acf9-4f4fd82fff0e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.273378 Jul 18 10:58:17.880476 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 573/1119] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:58:18.759783 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b98171ca-34c6-48f5-8eb7-027b79277150 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:18.760446 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b98171ca-34c6-48f5-8eb7-027b79277150 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:18.771336 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b98171ca-34c6-48f5-8eb7-027b79277150 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:18.771830 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b98171ca-34c6-48f5-8eb7-027b79277150 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:18.773082 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b98171ca-34c6-48f5-8eb7-027b79277150 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:18.773753 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b98171ca-34c6-48f5-8eb7-027b79277150 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:18.946841 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-b98171ca-34c6-48f5-8eb7-027b79277150 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:18.957194 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b98171ca-34c6-48f5-8eb7-027b79277150 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1318 microversion: 2.1 time: 0.201922 Jul 18 10:58:18.964516 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 547/1120] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:18 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:58:19.904745 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-503daec6-b494-41f5-bd35-c408ee245738 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-788856448"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:58:19.905559 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-503daec6-b494-41f5-bd35-c408ee245738 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:19.912894 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-503daec6-b494-41f5-bd35-c408ee245738 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:19.913353 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-503daec6-b494-41f5-bd35-c408ee245738 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:19.914162 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-503daec6-b494-41f5-bd35-c408ee245738 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:19.914634 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-503daec6-b494-41f5-bd35-c408ee245738 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:19.977183 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-4a0abc99-2b33-4e19-b2e3-842ec058aad6 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:19.977814 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-4a0abc99-2b33-4e19-b2e3-842ec058aad6 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:19.986408 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4a0abc99-2b33-4e19-b2e3-842ec058aad6 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:19.987508 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4a0abc99-2b33-4e19-b2e3-842ec058aad6 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:19.988325 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4a0abc99-2b33-4e19-b2e3-842ec058aad6 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:19.988758 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-4a0abc99-2b33-4e19-b2e3-842ec058aad6 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:20.112178 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.network.security_group_api [None req-503daec6-b494-41f5-bd35-c408ee245738 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Adding security group 39163b0d-5d4e-48ba-acdb-a8d8fb02d2ae to port f9f873c9-64f4-4f0f-a61d-410318c37f4a Jul 18 10:58:20.533133 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-4a0abc99-2b33-4e19-b2e3-842ec058aad6 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:20.541649 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-4a0abc99-2b33-4e19-b2e3-842ec058aad6 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1318 microversion: 2.1 time: 0.568774 Jul 18 10:58:20.542191 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 548/1121] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:19 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:58:21.075333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-503daec6-b494-41f5-bd35-c408ee245738 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "POST /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/action" status: 202 len: 0 microversion: 2.1 time: 1.177197 Jul 18 10:58:21.081939 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [req-c09278ac-f688-43ed-a48f-643793288d05 req-f05952d0-0abf-4c91-93b5-51bb0c17fdbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d23cc92-a156-4a44-8b76-f082f7c3484a", "tag": "f9f873c9-64f4-4f0f-a61d-410318c37f4a"}]} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:58:21.083280 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 574/1122] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 18 10:58:19 2022] POST /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/action => generated 0 bytes in 1187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:58:21.096151 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-c09278ac-f688-43ed-a48f-643793288d05 req-f05952d0-0abf-4c91-93b5-51bb0c17fdbd service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:21.103204 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [req-c09278ac-f688-43ed-a48f-643793288d05 req-f05952d0-0abf-4c91-93b5-51bb0c17fdbd service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:21.103452 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8f4929fb-96fe-4f4c-b204-460b3a44d488 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:21.103452 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-8f4929fb-96fe-4f4c-b204-460b3a44d488 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:21.111398 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f4929fb-96fe-4f4c-b204-460b3a44d488 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:21.112710 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f4929fb-96fe-4f4c-b204-460b3a44d488 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:21.114205 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f4929fb-96fe-4f4c-b204-460b3a44d488 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:21.116546 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8f4929fb-96fe-4f4c-b204-460b3a44d488 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:21.118291 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.compute.server_external_events [req-c09278ac-f688-43ed-a48f-643793288d05 req-f05952d0-0abf-4c91-93b5-51bb0c17fdbd service nova] Creating event network-changed:f9f873c9-64f4-4f0f-a61d-410318c37f4a for instance 7d23cc92-a156-4a44-8b76-f082f7c3484a on hv-cinder-84949 Jul 18 10:58:21.124763 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [req-c09278ac-f688-43ed-a48f-643793288d05 req-f05952d0-0abf-4c91-93b5-51bb0c17fdbd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047662 Jul 18 10:58:21.126531 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 549/1123] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:58:21.544134 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-8f4929fb-96fe-4f4c-b204-460b3a44d488 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:21.553138 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-8f4929fb-96fe-4f4c-b204-460b3a44d488 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1760 microversion: 2.1 time: 0.462865 Jul 18 10:58:21.565127 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a6e35c16-e08b-4d2e-9d55-b67d73b1b8cd tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:21.565930 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 575/1124] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:21 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1760 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:21.566078 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a6e35c16-e08b-4d2e-9d55-b67d73b1b8cd tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:21.574126 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a6e35c16-e08b-4d2e-9d55-b67d73b1b8cd tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:21.574913 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a6e35c16-e08b-4d2e-9d55-b67d73b1b8cd tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:21.575821 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a6e35c16-e08b-4d2e-9d55-b67d73b1b8cd tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:21.576988 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a6e35c16-e08b-4d2e-9d55-b67d73b1b8cd tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:21.862497 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a6e35c16-e08b-4d2e-9d55-b67d73b1b8cd tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:21.871627 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a6e35c16-e08b-4d2e-9d55-b67d73b1b8cd tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1507 microversion: 2.1 time: 0.312457 Jul 18 10:58:21.872248 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 550/1125] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:21 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:21.889807 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-8c099264-0e17-41f2-9943-9af676d33dd9 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8292d52f-8a53-4e98-8992-610cd82cfb7e", "device": "/dev/sdb"}} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:58:21.891508 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-8c099264-0e17-41f2-9943-9af676d33dd9 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:21.899237 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8c099264-0e17-41f2-9943-9af676d33dd9 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:21.899237 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8c099264-0e17-41f2-9943-9af676d33dd9 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:21.904218 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8c099264-0e17-41f2-9943-9af676d33dd9 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:21.904672 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-8c099264-0e17-41f2-9943-9af676d33dd9 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:23.161289 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-8c099264-0e17-41f2-9943-9af676d33dd9 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "POST /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.276083 Jul 18 10:58:23.162146 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 576/1126] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 18 10:58:21 2022] POST /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16/os-volume_attachments => generated 194 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:58:33.515574 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d82216fd-749a-485d-8201-62863b1b95c2 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:58:33.516927 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d82216fd-749a-485d-8201-62863b1b95c2 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:33.519791 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:58:33.520494 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=22 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:58:33.525399 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d82216fd-749a-485d-8201-62863b1b95c2 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:33.525901 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d82216fd-749a-485d-8201-62863b1b95c2 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:33.528908 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d82216fd-749a-485d-8201-62863b1b95c2 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:33.528908 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d82216fd-749a-485d-8201-62863b1b95c2 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:33.751309 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d82216fd-749a-485d-8201-62863b1b95c2 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "POST /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/action" status: 202 len: 0 microversion: 2.1 time: 0.239723 Jul 18 10:58:33.752030 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 551/1127] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 18 10:58:33 2022] POST /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:58:33.759065 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:58:33.759861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:58:33.764927 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-72c48093-ea07-4fc7-af43-c5b0fbf1aece tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:33.765691 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-72c48093-ea07-4fc7-af43-c5b0fbf1aece tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:33.771848 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-72c48093-ea07-4fc7-af43-c5b0fbf1aece tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:33.772295 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-72c48093-ea07-4fc7-af43-c5b0fbf1aece tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:33.773108 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-72c48093-ea07-4fc7-af43-c5b0fbf1aece tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:33.773595 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-72c48093-ea07-4fc7-af43-c5b0fbf1aece tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:33.938307 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-72c48093-ea07-4fc7-af43-c5b0fbf1aece tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:33.946470 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-72c48093-ea07-4fc7-af43-c5b0fbf1aece tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1752 microversion: 2.1 time: 0.189877 Jul 18 10:58:33.947193 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 577/1128] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:33 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:34.966133 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-eaf27f35-aea8-46ff-9213-9aa4c50c20ff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:34.969327 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-eaf27f35-aea8-46ff-9213-9aa4c50c20ff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:34.975878 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-eaf27f35-aea8-46ff-9213-9aa4c50c20ff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:34.976485 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-eaf27f35-aea8-46ff-9213-9aa4c50c20ff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:34.977547 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-eaf27f35-aea8-46ff-9213-9aa4c50c20ff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:34.978080 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-eaf27f35-aea8-46ff-9213-9aa4c50c20ff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:35.279103 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-eaf27f35-aea8-46ff-9213-9aa4c50c20ff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:35.293777 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-eaf27f35-aea8-46ff-9213-9aa4c50c20ff tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1752 microversion: 2.1 time: 0.332359 Jul 18 10:58:35.294889 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 552/1129] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:34 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1752 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:36.321185 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-7fbf69ca-a013-4ea9-a0c3-d2ff6fefd8c5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:36.321771 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-7fbf69ca-a013-4ea9-a0c3-d2ff6fefd8c5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:36.329506 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7fbf69ca-a013-4ea9-a0c3-d2ff6fefd8c5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:36.330055 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7fbf69ca-a013-4ea9-a0c3-d2ff6fefd8c5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:36.330888 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7fbf69ca-a013-4ea9-a0c3-d2ff6fefd8c5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:36.331350 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-7fbf69ca-a013-4ea9-a0c3-d2ff6fefd8c5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:36.509422 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-7fbf69ca-a013-4ea9-a0c3-d2ff6fefd8c5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:36.518555 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-7fbf69ca-a013-4ea9-a0c3-d2ff6fefd8c5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1757 microversion: 2.1 time: 0.201365 Jul 18 10:58:36.519191 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 578/1130] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:36 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1757 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:37.540222 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b2b2be79-d4ec-41f3-a05c-1fd46520b06c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:37.541235 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b2b2be79-d4ec-41f3-a05c-1fd46520b06c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:37.550228 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b2b2be79-d4ec-41f3-a05c-1fd46520b06c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:37.551012 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b2b2be79-d4ec-41f3-a05c-1fd46520b06c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:37.551948 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b2b2be79-d4ec-41f3-a05c-1fd46520b06c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:37.552544 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b2b2be79-d4ec-41f3-a05c-1fd46520b06c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:37.726405 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-b2b2be79-d4ec-41f3-a05c-1fd46520b06c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:37.735079 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b2b2be79-d4ec-41f3-a05c-1fd46520b06c tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1757 microversion: 2.1 time: 0.200747 Jul 18 10:58:37.735644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 553/1131] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:37 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:38.753257 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-f48f313f-38c8-4c84-9855-b8080e333a5a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:38.753882 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-f48f313f-38c8-4c84-9855-b8080e333a5a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:38.761212 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f48f313f-38c8-4c84-9855-b8080e333a5a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:38.761664 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f48f313f-38c8-4c84-9855-b8080e333a5a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:38.762428 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f48f313f-38c8-4c84-9855-b8080e333a5a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:38.762853 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-f48f313f-38c8-4c84-9855-b8080e333a5a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:38.921554 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-f48f313f-38c8-4c84-9855-b8080e333a5a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:38.929944 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-f48f313f-38c8-4c84-9855-b8080e333a5a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1757 microversion: 2.1 time: 0.180745 Jul 18 10:58:38.930553 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 579/1132] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:38 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:39.946944 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d66d8cc9-b34f-4115-80e6-62f8d02f3b1a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:39.948343 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d66d8cc9-b34f-4115-80e6-62f8d02f3b1a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:39.955791 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d66d8cc9-b34f-4115-80e6-62f8d02f3b1a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:39.956331 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d66d8cc9-b34f-4115-80e6-62f8d02f3b1a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:39.957128 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d66d8cc9-b34f-4115-80e6-62f8d02f3b1a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:39.957556 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d66d8cc9-b34f-4115-80e6-62f8d02f3b1a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:40.129963 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-d66d8cc9-b34f-4115-80e6-62f8d02f3b1a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:40.139269 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d66d8cc9-b34f-4115-80e6-62f8d02f3b1a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1757 microversion: 2.1 time: 0.196214 Jul 18 10:58:40.139825 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 554/1133] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:39 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:41.167016 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-434fdc84-d891-48da-a708-b4cd25bb80f9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:41.167604 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-434fdc84-d891-48da-a708-b4cd25bb80f9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:41.174207 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-434fdc84-d891-48da-a708-b4cd25bb80f9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:41.174656 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-434fdc84-d891-48da-a708-b4cd25bb80f9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:41.175423 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-434fdc84-d891-48da-a708-b4cd25bb80f9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:41.175856 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-434fdc84-d891-48da-a708-b4cd25bb80f9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:41.330620 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-434fdc84-d891-48da-a708-b4cd25bb80f9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:41.339796 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-434fdc84-d891-48da-a708-b4cd25bb80f9 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1757 microversion: 2.1 time: 0.176750 Jul 18 10:58:41.340544 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 580/1134] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:41 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:42.358045 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a64dd4f4-29cb-49f2-b6f6-ee231ebb0c34 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:42.358756 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a64dd4f4-29cb-49f2-b6f6-ee231ebb0c34 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:42.365267 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a64dd4f4-29cb-49f2-b6f6-ee231ebb0c34 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:42.365639 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a64dd4f4-29cb-49f2-b6f6-ee231ebb0c34 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:42.366409 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a64dd4f4-29cb-49f2-b6f6-ee231ebb0c34 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:42.366840 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a64dd4f4-29cb-49f2-b6f6-ee231ebb0c34 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:42.527519 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a64dd4f4-29cb-49f2-b6f6-ee231ebb0c34 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:42.535946 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a64dd4f4-29cb-49f2-b6f6-ee231ebb0c34 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1757 microversion: 2.1 time: 0.182746 Jul 18 10:58:42.536528 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 555/1135] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:42 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:43.554263 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-baf47f1b-6133-449e-a59c-08ca973b60ce tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:43.554964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-baf47f1b-6133-449e-a59c-08ca973b60ce tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:43.562205 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-baf47f1b-6133-449e-a59c-08ca973b60ce tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:43.562648 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-baf47f1b-6133-449e-a59c-08ca973b60ce tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:43.563466 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-baf47f1b-6133-449e-a59c-08ca973b60ce tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:43.563849 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-baf47f1b-6133-449e-a59c-08ca973b60ce tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:43.710306 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-baf47f1b-6133-449e-a59c-08ca973b60ce tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:43.719228 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-baf47f1b-6133-449e-a59c-08ca973b60ce tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1757 microversion: 2.1 time: 0.168869 Jul 18 10:58:43.719803 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 581/1136] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:43 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:43.860712 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-37c2a5b7-e462-4d20-861e-d45f7c1fe736 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:43.863845 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-37c2a5b7-e462-4d20-861e-d45f7c1fe736 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:43.868076 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-37c2a5b7-e462-4d20-861e-d45f7c1fe736 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:43.868518 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-37c2a5b7-e462-4d20-861e-d45f7c1fe736 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:43.869993 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-37c2a5b7-e462-4d20-861e-d45f7c1fe736 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:43.870401 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-37c2a5b7-e462-4d20-861e-d45f7c1fe736 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:43.961853 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-37c2a5b7-e462-4d20-861e-d45f7c1fe736 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lazy-loading 'services' on Instance uuid 8f208141-cbfc-4236-ae8e-c665ea4d8c16 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:58:44.172482 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-37c2a5b7-e462-4d20-861e-d45f7c1fe736 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16/os-volume_attachments/8292d52f-8a53-4e98-8992-610cd82cfb7e" status: 202 len: 0 microversion: 2.1 time: 0.315590 Jul 18 10:58:44.173159 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 556/1137] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 18 10:58:43 2022] DELETE /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16/os-volume_attachments/8292d52f-8a53-4e98-8992-610cd82cfb7e => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:58:44.737534 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0ac689af-ef2e-4229-a942-cc7ecd662f72 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:44.739056 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-0ac689af-ef2e-4229-a942-cc7ecd662f72 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:44.747658 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0ac689af-ef2e-4229-a942-cc7ecd662f72 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:44.750825 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0ac689af-ef2e-4229-a942-cc7ecd662f72 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:44.750825 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0ac689af-ef2e-4229-a942-cc7ecd662f72 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:44.750825 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0ac689af-ef2e-4229-a942-cc7ecd662f72 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:44.910866 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-0ac689af-ef2e-4229-a942-cc7ecd662f72 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:44.919169 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-0ac689af-ef2e-4229-a942-cc7ecd662f72 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1757 microversion: 2.1 time: 0.185642 Jul 18 10:58:44.919824 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 582/1138] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:44 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:58:45.293864 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-222f7dfb-3a09-490a-a6ea-5bfa38024eb2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:45.294466 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-222f7dfb-3a09-490a-a6ea-5bfa38024eb2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:45.301030 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-222f7dfb-3a09-490a-a6ea-5bfa38024eb2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:45.305022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-222f7dfb-3a09-490a-a6ea-5bfa38024eb2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:45.305022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-222f7dfb-3a09-490a-a6ea-5bfa38024eb2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:45.305022 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-222f7dfb-3a09-490a-a6ea-5bfa38024eb2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:45.330667 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-222f7dfb-3a09-490a-a6ea-5bfa38024eb2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Going to try to terminate instance {{(pid=125005) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:58:45.925473 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-222f7dfb-3a09-490a-a6ea-5bfa38024eb2 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 204 len: 0 microversion: 2.1 time: 0.636363 Jul 18 10:58:45.926185 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 557/1139] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:58:45 2022] DELETE /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:58:45.934810 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4fc52c87-75cc-4f36-bdcd-cc1ea166342e tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:45.935543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-4fc52c87-75cc-4f36-bdcd-cc1ea166342e tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:45.942519 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4fc52c87-75cc-4f36-bdcd-cc1ea166342e tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:45.942957 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4fc52c87-75cc-4f36-bdcd-cc1ea166342e tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:45.943107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-a8d11387-9748-4387-85b8-cbe38c55c7b0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:45.943734 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4fc52c87-75cc-4f36-bdcd-cc1ea166342e tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:45.944038 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-a8d11387-9748-4387-85b8-cbe38c55c7b0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:45.944206 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4fc52c87-75cc-4f36-bdcd-cc1ea166342e tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:45.950237 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a8d11387-9748-4387-85b8-cbe38c55c7b0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:45.955951 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a8d11387-9748-4387-85b8-cbe38c55c7b0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:45.955951 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a8d11387-9748-4387-85b8-cbe38c55c7b0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:45.955951 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-a8d11387-9748-4387-85b8-cbe38c55c7b0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:46.153453 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-4fc52c87-75cc-4f36-bdcd-cc1ea166342e tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:46.163096 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4fc52c87-75cc-4f36-bdcd-cc1ea166342e tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1513 microversion: 2.1 time: 0.232182 Jul 18 10:58:46.163705 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 583/1140] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:45 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:46.179894 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-a8d11387-9748-4387-85b8-cbe38c55c7b0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:46.188444 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-a8d11387-9748-4387-85b8-cbe38c55c7b0 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1757 microversion: 2.1 time: 0.249971 Jul 18 10:58:46.189061 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 558/1141] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:45 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1757 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:58:47.180645 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-03927257-5025-4eb0-88fb-780a4bea9bcf tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:47.229982 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-03927257-5025-4eb0-88fb-780a4bea9bcf tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:47.229982 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-03927257-5025-4eb0-88fb-780a4bea9bcf tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:47.229982 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-03927257-5025-4eb0-88fb-780a4bea9bcf tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:47.229982 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-03927257-5025-4eb0-88fb-780a4bea9bcf tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:47.230400 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-03927257-5025-4eb0-88fb-780a4bea9bcf tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:47.230496 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-c4a0733a-15b8-478a-9463-4a4fba77558f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:47.230496 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-c4a0733a-15b8-478a-9463-4a4fba77558f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:47.230496 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c4a0733a-15b8-478a-9463-4a4fba77558f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:47.230496 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c4a0733a-15b8-478a-9463-4a4fba77558f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:47.231249 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c4a0733a-15b8-478a-9463-4a4fba77558f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:47.231249 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-c4a0733a-15b8-478a-9463-4a4fba77558f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:47.395046 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-03927257-5025-4eb0-88fb-780a4bea9bcf tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:47.402847 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-03927257-5025-4eb0-88fb-780a4bea9bcf tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1513 microversion: 2.1 time: 0.226134 Jul 18 10:58:47.403531 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 584/1142] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:47 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:47.420688 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-c4a0733a-15b8-478a-9463-4a4fba77558f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:47.429269 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-c4a0733a-15b8-478a-9463-4a4fba77558f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1757 microversion: 2.1 time: 0.226104 Jul 18 10:58:47.429843 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 559/1143] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:47 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1757 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:48.419750 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0d1adb93-c8cc-4b08-9c0d-9345c90d6a06 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:48.420362 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-0d1adb93-c8cc-4b08-9c0d-9345c90d6a06 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:48.427202 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0d1adb93-c8cc-4b08-9c0d-9345c90d6a06 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:48.429523 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0d1adb93-c8cc-4b08-9c0d-9345c90d6a06 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:48.429523 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0d1adb93-c8cc-4b08-9c0d-9345c90d6a06 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:48.429523 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0d1adb93-c8cc-4b08-9c0d-9345c90d6a06 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:48.448644 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-3214ab0e-5f3e-44c1-aa5d-0685dbc588fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:48.449712 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-3214ab0e-5f3e-44c1-aa5d-0685dbc588fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:48.456409 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3214ab0e-5f3e-44c1-aa5d-0685dbc588fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:48.456904 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3214ab0e-5f3e-44c1-aa5d-0685dbc588fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:48.457678 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3214ab0e-5f3e-44c1-aa5d-0685dbc588fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:48.458370 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-3214ab0e-5f3e-44c1-aa5d-0685dbc588fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:48.772696 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-0d1adb93-c8cc-4b08-9c0d-9345c90d6a06 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:48.781110 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-0d1adb93-c8cc-4b08-9c0d-9345c90d6a06 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1513 microversion: 2.1 time: 0.365259 Jul 18 10:58:48.781714 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 585/1144] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:48 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1513 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:48.803222 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-3214ab0e-5f3e-44c1-aa5d-0685dbc588fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:48.812690 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-3214ab0e-5f3e-44c1-aa5d-0685dbc588fe tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1760 microversion: 2.1 time: 0.369228 Jul 18 10:58:48.813313 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 560/1145] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:48 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1760 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:58:49.105936 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-77f87319-abf8-4684-8f2b-5e02bcfda3e6 req-4aa522cb-7403-4498-a642-4ce253c53e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f208141-cbfc-4236-ae8e-c665ea4d8c16", "name": "network-vif-deleted", "tag": "b742f0a4-6f8f-4634-b68b-2feaf81467aa"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:58:49.116264 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-77f87319-abf8-4684-8f2b-5e02bcfda3e6 req-4aa522cb-7403-4498-a642-4ce253c53e79 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:49.118750 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-77f87319-abf8-4684-8f2b-5e02bcfda3e6 req-4aa522cb-7403-4498-a642-4ce253c53e79 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:49.129764 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-77f87319-abf8-4684-8f2b-5e02bcfda3e6 req-4aa522cb-7403-4498-a642-4ce253c53e79 service nova] Creating event network-vif-deleted:b742f0a4-6f8f-4634-b68b-2feaf81467aa for instance 8f208141-cbfc-4236-ae8e-c665ea4d8c16 on hv-cinder-84949 Jul 18 10:58:49.135634 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-77f87319-abf8-4684-8f2b-5e02bcfda3e6 req-4aa522cb-7403-4498-a642-4ce253c53e79 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033130 Jul 18 10:58:49.136452 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 586/1146] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:58:49.805691 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d02398a1-e299-4038-bea8-e8b6c24dfb2d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:49.806324 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d02398a1-e299-4038-bea8-e8b6c24dfb2d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:49.813591 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d02398a1-e299-4038-bea8-e8b6c24dfb2d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:49.814158 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d02398a1-e299-4038-bea8-e8b6c24dfb2d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:49.815063 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d02398a1-e299-4038-bea8-e8b6c24dfb2d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:49.815484 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d02398a1-e299-4038-bea8-e8b6c24dfb2d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:49.850680 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d02398a1-e299-4038-bea8-e8b6c24dfb2d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:49.851118 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d02398a1-e299-4038-bea8-e8b6c24dfb2d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:49.851570 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-d02398a1-e299-4038-bea8-e8b6c24dfb2d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lazy-loading 'fault' on Instance uuid 8f208141-cbfc-4236-ae8e-c665ea4d8c16 {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:58:49.894976 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-d02398a1-e299-4038-bea8-e8b6c24dfb2d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd612283280884f119b50cceae973a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3f09bf74324f7ca7268feb67c046f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:58:49.902907 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d02398a1-e299-4038-bea8-e8b6c24dfb2d tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 200 len: 1308 microversion: 2.1 time: 0.106902 Jul 18 10:58:49.911461 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 561/1147] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:49 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:58:50.922413 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0b7c2760-a9c3-48ce-82eb-09bde0a93ff8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:58:50.923112 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-0b7c2760-a9c3-48ce-82eb-09bde0a93ff8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] [instance: 8f208141-cbfc-4236-ae8e-c665ea4d8c16] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:58:50.929854 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0b7c2760-a9c3-48ce-82eb-09bde0a93ff8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:50.930351 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0b7c2760-a9c3-48ce-82eb-09bde0a93ff8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:50.931175 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0b7c2760-a9c3-48ce-82eb-09bde0a93ff8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:58:50.932140 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-0b7c2760-a9c3-48ce-82eb-09bde0a93ff8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:58:50.946538 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-0b7c2760-a9c3-48ce-82eb-09bde0a93ff8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] HTTP exception thrown: Instance 8f208141-cbfc-4236-ae8e-c665ea4d8c16 could not be found. Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0b7c2760-a9c3-48ce-82eb-09bde0a93ff8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Request method failure captured: Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 HTTP/1.1 Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1TxmrkwbWKp2Xp0Dq0VqDEYNgI3z9cCVfUFeviPzzVmkXSlAwmeDboWU2E1weHgwa6DI8jKuVHgI-sQ3SwB8FLbhwNrNVq8kVy66-mQGQNNaGV1tHNzyPC3Ddg5L79PDGp1zFiXqqpDTcC9NsIDTwUDrwXE1S6imNKzEK9BAqgQ1ttk Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: bf3f09bf74324f7ca7268feb67c046f8 Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2076963517 Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:58:50.948870 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:58:50.950694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bf3f09bf74324f7ca7268feb67c046f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bf3f09bf74324f7ca7268feb67c046f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bf3f09bf74324f7ca7268feb67c046f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bf3f09bf74324f7ca7268feb67c046f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:58:50.950694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-VolumesSnapshotTestJSON-2076963517 Jul 18 10:58:50.950694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: bf3f09bf74324f7ca7268feb67c046f8 Jul 18 10:58:50.950694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2076963517 Jul 18 10:58:50.950694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-VolumesSnapshotTestJSON-2076963517-project Jul 18 10:58:50.950694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:58:50.950694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:58:50.950694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: d612283280884f119b50cceae973a6ec Jul 18 10:58:50.950694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-VolumesSnapshotTestJSON-2076963517-project Jul 18 10:58:50.950694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:58:50.950694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 8f208141-cbfc-4236-ae8e-c665ea4d8c16 could not be found. Jul 18 10:58:50.950694 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '8f208141-cbfc-4236-ae8e-c665ea4d8c16'} Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f208141-cbfc-4236-ae8e-c665ea4d8c16 could not be found. Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:58:50.951673 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f208141-cbfc-4236-ae8e-c665ea4d8c16 could not be found. Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f208141-cbfc-4236-ae8e-c665ea4d8c16 could not be found. Jul 18 10:58:50.953333 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:58:50.954752 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-0b7c2760-a9c3-48ce-82eb-09bde0a93ff8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] Returning 404 to user: Instance 8f208141-cbfc-4236-ae8e-c665ea4d8c16 could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:58:50.954752 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-0b7c2760-a9c3-48ce-82eb-09bde0a93ff8 tempest-VolumesSnapshotTestJSON-2076963517 tempest-VolumesSnapshotTestJSON-2076963517-project] 10.222.0.49 "GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16" status: 404 len: 111 microversion: 2.1 time: 0.032820 Jul 18 10:58:50.954752 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 587/1148] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:58:50 2022] GET /compute/v2.1/servers/8f208141-cbfc-4236-ae8e-c665ea4d8c16 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:59:26.706479 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-f0bb9b1b-632a-435f-a4fd-6cac61f008c3 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-788856448"}} {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:59:26.707131 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-f0bb9b1b-632a-435f-a4fd-6cac61f008c3 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:59:26.709758 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:59:26.710411 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG dbcounter [-] [125005] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125005) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:59:26.716190 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f0bb9b1b-632a-435f-a4fd-6cac61f008c3 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:26.716700 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f0bb9b1b-632a-435f-a4fd-6cac61f008c3 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:26.717556 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f0bb9b1b-632a-435f-a4fd-6cac61f008c3 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:26.717987 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-f0bb9b1b-632a-435f-a4fd-6cac61f008c3 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:26.857077 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.network.security_group_api [None req-f0bb9b1b-632a-435f-a4fd-6cac61f008c3 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Removing security group 39163b0d-5d4e-48ba-acdb-a8d8fb02d2ae from port f9f873c9-64f4-4f0f-a61d-410318c37f4a Jul 18 10:59:27.296509 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-f0bb9b1b-632a-435f-a4fd-6cac61f008c3 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "POST /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/action" status: 202 len: 0 microversion: 2.1 time: 0.593873 Jul 18 10:59:27.297451 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 562/1149] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 18 10:59:26 2022] POST /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:59:27.311543 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-bd073860-165e-4090-b892-4aaf2412df99 req-314e6662-b6ec-4f77-9021-943938eb2f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d23cc92-a156-4a44-8b76-f082f7c3484a", "tag": "f9f873c9-64f4-4f0f-a61d-410318c37f4a"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:59:27.324312 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_api:SELECT=22 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:59:27.332290 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG dbcounter [-] [125007] Writing DB stats nova_cell1:SELECT=58 {{(pid=125007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:59:27.335779 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-bd073860-165e-4090-b892-4aaf2412df99 req-314e6662-b6ec-4f77-9021-943938eb2f38 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:27.341117 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-bd073860-165e-4090-b892-4aaf2412df99 req-314e6662-b6ec-4f77-9021-943938eb2f38 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:27.357723 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-bd073860-165e-4090-b892-4aaf2412df99 req-314e6662-b6ec-4f77-9021-943938eb2f38 service nova] Creating event network-changed:f9f873c9-64f4-4f0f-a61d-410318c37f4a for instance 7d23cc92-a156-4a44-8b76-f082f7c3484a on hv-cinder-84949 Jul 18 10:59:27.363592 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-bd073860-165e-4090-b892-4aaf2412df99 req-314e6662-b6ec-4f77-9021-943938eb2f38 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055729 Jul 18 10:59:27.364251 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 588/1150] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:59:28.733059 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-d4f6d1a3-0b50-401f-8387-423151b668bc tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:59:28.733682 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-d4f6d1a3-0b50-401f-8387-423151b668bc tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:59:28.739443 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-ce9f907b-0bab-47aa-9ca4-fa54465c6b60 req-f333d22d-3345-4b35-9d08-903fdfbdd485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d23cc92-a156-4a44-8b76-f082f7c3484a", "tag": "f9f873c9-64f4-4f0f-a61d-410318c37f4a"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:59:28.740337 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d4f6d1a3-0b50-401f-8387-423151b668bc tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:28.741623 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d4f6d1a3-0b50-401f-8387-423151b668bc tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:28.742391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d4f6d1a3-0b50-401f-8387-423151b668bc tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:28.743638 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-d4f6d1a3-0b50-401f-8387-423151b668bc tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:28.750992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-ce9f907b-0bab-47aa-9ca4-fa54465c6b60 req-f333d22d-3345-4b35-9d08-903fdfbdd485 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:28.751441 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-ce9f907b-0bab-47aa-9ca4-fa54465c6b60 req-f333d22d-3345-4b35-9d08-903fdfbdd485 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:28.765232 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-ce9f907b-0bab-47aa-9ca4-fa54465c6b60 req-f333d22d-3345-4b35-9d08-903fdfbdd485 service nova] Creating event network-changed:f9f873c9-64f4-4f0f-a61d-410318c37f4a for instance 7d23cc92-a156-4a44-8b76-f082f7c3484a on hv-cinder-84949 Jul 18 10:59:28.770910 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-ce9f907b-0bab-47aa-9ca4-fa54465c6b60 req-f333d22d-3345-4b35-9d08-903fdfbdd485 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036789 Jul 18 10:59:28.771816 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 589/1151] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:59:28.845468 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-d4f6d1a3-0b50-401f-8387-423151b668bc tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lazy-loading 'services' on Instance uuid 7d23cc92-a156-4a44-8b76-f082f7c3484a {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:59:29.106371 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-d4f6d1a3-0b50-401f-8387-423151b668bc tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments/2820a3e1-5739-4501-a120-0a67aa5b2e87" status: 202 len: 0 microversion: 2.1 time: 0.378171 Jul 18 10:59:29.106986 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 563/1152] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 18 10:59:28 2022] DELETE /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments/2820a3e1-5739-4501-a120-0a67aa5b2e87 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:59:29.116185 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-ae2b4b9a-ec64-485d-a309-b3c272d56ba5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:59:29.117235 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-ae2b4b9a-ec64-485d-a309-b3c272d56ba5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:59:29.124861 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ae2b4b9a-ec64-485d-a309-b3c272d56ba5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:29.125314 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ae2b4b9a-ec64-485d-a309-b3c272d56ba5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:29.126103 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ae2b4b9a-ec64-485d-a309-b3c272d56ba5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:29.126532 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-ae2b4b9a-ec64-485d-a309-b3c272d56ba5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:29.160964 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-ae2b4b9a-ec64-485d-a309-b3c272d56ba5 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049199 Jul 18 10:59:29.161564 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 590/1153] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:59:29 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:59:30.175373 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-0e46d7a1-0ef0-4c41-aa40-c63909c54e38 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:59:30.176425 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-0e46d7a1-0ef0-4c41-aa40-c63909c54e38 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:59:30.182759 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0e46d7a1-0ef0-4c41-aa40-c63909c54e38 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:30.183202 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0e46d7a1-0ef0-4c41-aa40-c63909c54e38 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:30.184047 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0e46d7a1-0ef0-4c41-aa40-c63909c54e38 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:30.184472 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-0e46d7a1-0ef0-4c41-aa40-c63909c54e38 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:30.215256 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-0e46d7a1-0ef0-4c41-aa40-c63909c54e38 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045732 Jul 18 10:59:30.215827 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 564/1154] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:59:30 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:59:31.230948 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-4e06453a-4219-4070-ad65-bb47d22e322a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:59:31.232017 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-4e06453a-4219-4070-ad65-bb47d22e322a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:59:31.239063 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4e06453a-4219-4070-ad65-bb47d22e322a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:31.239531 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4e06453a-4219-4070-ad65-bb47d22e322a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:31.240306 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4e06453a-4219-4070-ad65-bb47d22e322a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:31.240738 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-4e06453a-4219-4070-ad65-bb47d22e322a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:31.275261 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-4e06453a-4219-4070-ad65-bb47d22e322a tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048050 Jul 18 10:59:31.275987 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 591/1155] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:59:31 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:59:32.287351 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-e8cf5374-b25f-4fc9-81b7-55e8ebd2b871 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:59:32.288274 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-e8cf5374-b25f-4fc9-81b7-55e8ebd2b871 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:59:32.295844 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e8cf5374-b25f-4fc9-81b7-55e8ebd2b871 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:32.296565 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e8cf5374-b25f-4fc9-81b7-55e8ebd2b871 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:32.297381 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e8cf5374-b25f-4fc9-81b7-55e8ebd2b871 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:32.297878 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-e8cf5374-b25f-4fc9-81b7-55e8ebd2b871 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:32.329107 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-e8cf5374-b25f-4fc9-81b7-55e8ebd2b871 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045866 Jul 18 10:59:32.329652 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 565/1156] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:59:32 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:59:33.341518 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-2afb4752-7a5b-4179-bb2c-b694d4c78899 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:59:33.342485 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-2afb4752-7a5b-4179-bb2c-b694d4c78899 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:59:33.349449 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2afb4752-7a5b-4179-bb2c-b694d4c78899 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:33.349978 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2afb4752-7a5b-4179-bb2c-b694d4c78899 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:33.350911 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2afb4752-7a5b-4179-bb2c-b694d4c78899 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:33.351395 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-2afb4752-7a5b-4179-bb2c-b694d4c78899 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:33.382094 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-2afb4752-7a5b-4179-bb2c-b694d4c78899 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045613 Jul 18 10:59:33.382668 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 592/1157] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 18 10:59:33 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:59:33.393621 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-43fa0081-74ff-4e00-a0d2-87ed4ebc8004 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:59:33.394207 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-43fa0081-74ff-4e00-a0d2-87ed4ebc8004 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:59:33.401441 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-43fa0081-74ff-4e00-a0d2-87ed4ebc8004 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:33.401884 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-43fa0081-74ff-4e00-a0d2-87ed4ebc8004 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:33.402680 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-43fa0081-74ff-4e00-a0d2-87ed4ebc8004 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:33.403116 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-43fa0081-74ff-4e00-a0d2-87ed4ebc8004 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:33.483761 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.wsgi [None req-43fa0081-74ff-4e00-a0d2-87ed4ebc8004 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] HTTP exception thrown: Instance 7d23cc92-a156-4a44-8b76-f082f7c3484a is not attached to volume 2820a3e1-5739-4501-a120-0a67aa5b2e87 Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-43fa0081-74ff-4e00-a0d2-87ed4ebc8004 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Request method failure captured: Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: request: DELETE /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments/2820a3e1-5739-4501-a120-0a67aa5b2e87 HTTP/1.1 Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept: application/json Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Accept-Encoding: identity Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Connection: close Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Length: 0 Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Content-Type: application/json Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Host: 10.222.0.49 Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Openstack-System-Scope: None Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: User-Agent: python-urllib3/1.26.9 Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Auth-Token: gAAAAABi1TyAlnYJI_cffNRYqibiwS19E8pbBNs8wb-82239fMoLD_uroO87nLeqjqBW4zEdfIzK2dx5p6ZV83aNJBiNvqdrq9J20QhP89E2g2JFOa2MCXgXJ-xQitxSj0BiTmVonqzcouzpMgfmyOFW8pQ1LmeFlIRB6E6kwchtLVT067G86zM Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Id: None Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Domain-Name: None Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Identity-Status: Confirmed Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Is-Admin-Project: True Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Id: default Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Domain-Name: Default Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Id: abc1cd8a20854cb0ac847cf30c1343eb Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Project-Name: tempest-TestMinimumBasicScenario-61130234 Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Role: reader,member Jul 18 10:59:33.486295 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Roles: reader,member Jul 18 10:59:33.488149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc1cd8a20854cb0ac847cf30c1343eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_abc1cd8a20854cb0ac847cf30c1343eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc1cd8a20854cb0ac847cf30c1343eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/abc1cd8a20854cb0ac847cf30c1343eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:59:33.488149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant: tempest-TestMinimumBasicScenario-61130234 Jul 18 10:59:33.488149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Id: abc1cd8a20854cb0ac847cf30c1343eb Jul 18 10:59:33.488149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-Tenant-Name: tempest-TestMinimumBasicScenario-61130234 Jul 18 10:59:33.488149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User: tempest-TestMinimumBasicScenario-61130234-project Jul 18 10:59:33.488149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Id: default Jul 18 10:59:33.488149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Domain-Name: Default Jul 18 10:59:33.488149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Id: 5275b73fe98746879d090ab7713afd1e Jul 18 10:59:33.488149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: X-User-Name: tempest-TestMinimumBasicScenario-61130234-project Jul 18 10:59:33.488149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: method: > Jul 18 10:59:33.488149 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: exception: Instance 7d23cc92-a156-4a44-8b76-f082f7c3484a is not attached to volume 2820a3e1-5739-4501-a120-0a67aa5b2e87 Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: action_args: {'server_id': '7d23cc92-a156-4a44-8b76-f082f7c3484a', 'id': '2820a3e1-5739-4501-a120-0a67aa5b2e87'} Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2820a3e1-5739-4501-a120-0a67aa5b2e87. Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:59:33.489224 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:59:33.490905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:59:33.490905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 10:59:33.490905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 10:59:33.490905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d23cc92-a156-4a44-8b76-f082f7c3484a is not attached to volume 2820a3e1-5739-4501-a120-0a67aa5b2e87 Jul 18 10:59:33.490905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:59:33.490905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:59:33.490905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:59:33.490905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:59:33.490905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:59:33.490905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:59:33.490905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:59:33.490905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:59:33.490905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d23cc92-a156-4a44-8b76-f082f7c3484a is not attached to volume 2820a3e1-5739-4501-a120-0a67aa5b2e87 Jul 18 10:59:33.490905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: ERROR nova.api.openstack.wsgi Jul 18 10:59:33.490905 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-43fa0081-74ff-4e00-a0d2-87ed4ebc8004 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Returning 404 to user: Instance 7d23cc92-a156-4a44-8b76-f082f7c3484a is not attached to volume 2820a3e1-5739-4501-a120-0a67aa5b2e87 {{(pid=125005) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:59:33.492220 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-43fa0081-74ff-4e00-a0d2-87ed4ebc8004 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments/2820a3e1-5739-4501-a120-0a67aa5b2e87" status: 404 len: 154 microversion: 2.1 time: 0.098212 Jul 18 10:59:33.492220 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 566/1158] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 18 10:59:33 2022] DELETE /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a/os-volume_attachments/2820a3e1-5739-4501-a120-0a67aa5b2e87 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:59:36.905843 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-27b6cb26-883f-4123-a537-1b7b6ca1e8d4 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:59:36.906691 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-27b6cb26-883f-4123-a537-1b7b6ca1e8d4 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:59:36.916531 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-27b6cb26-883f-4123-a537-1b7b6ca1e8d4 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:36.917353 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-27b6cb26-883f-4123-a537-1b7b6ca1e8d4 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:36.918761 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-27b6cb26-883f-4123-a537-1b7b6ca1e8d4 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:36.919503 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-27b6cb26-883f-4123-a537-1b7b6ca1e8d4 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:36.959493 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-27b6cb26-883f-4123-a537-1b7b6ca1e8d4 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Going to try to terminate instance {{(pid=125007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:59:37.358087 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-27b6cb26-883f-4123-a537-1b7b6ca1e8d4 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 204 len: 0 microversion: 2.1 time: 0.458344 Jul 18 10:59:37.358674 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 593/1159] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 18 10:59:36 2022] DELETE /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:59:37.367028 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-8443b779-5083-420f-8e19-de21b3eea589 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:59:37.370926 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-8443b779-5083-420f-8e19-de21b3eea589 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:59:37.376005 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8443b779-5083-420f-8e19-de21b3eea589 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:37.376454 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8443b779-5083-420f-8e19-de21b3eea589 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:37.377273 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8443b779-5083-420f-8e19-de21b3eea589 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:37.377709 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-8443b779-5083-420f-8e19-de21b3eea589 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:37.530510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-8443b779-5083-420f-8e19-de21b3eea589 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:59:37.538977 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-8443b779-5083-420f-8e19-de21b3eea589 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1555 microversion: 2.1 time: 0.175862 Jul 18 10:59:37.539648 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 567/1160] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:59:37 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:59:38.558405 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-693e6868-b705-459a-9e20-09884ae68e7f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:59:38.559121 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-693e6868-b705-459a-9e20-09884ae68e7f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:59:38.565901 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-693e6868-b705-459a-9e20-09884ae68e7f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:38.566370 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-693e6868-b705-459a-9e20-09884ae68e7f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:38.567127 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-693e6868-b705-459a-9e20-09884ae68e7f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:38.567555 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-693e6868-b705-459a-9e20-09884ae68e7f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:38.707893 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.policy [None req-693e6868-b705-459a-9e20-09884ae68e7f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:59:38.716443 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-693e6868-b705-459a-9e20-09884ae68e7f tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1555 microversion: 2.1 time: 0.163172 Jul 18 10:59:38.717061 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 594/1161] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:59:38 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:59:39.735184 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-09291125-3741-435e-9550-8364e8ec85c7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:59:39.735810 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-09291125-3741-435e-9550-8364e8ec85c7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:59:39.743539 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-09291125-3741-435e-9550-8364e8ec85c7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:39.744046 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-09291125-3741-435e-9550-8364e8ec85c7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:39.744933 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-09291125-3741-435e-9550-8364e8ec85c7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:39.745370 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-09291125-3741-435e-9550-8364e8ec85c7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:39.956072 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-09291125-3741-435e-9550-8364e8ec85c7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:59:39.966546 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-09291125-3741-435e-9550-8364e8ec85c7 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1555 microversion: 2.1 time: 0.235798 Jul 18 10:59:39.967503 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 568/1162] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:59:39 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1555 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:59:40.213931 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [req-3ecccc5e-f490-4aa4-a96b-a16d7d1fedd5 req-660f7e11-f8f0-493c-b10b-3d147885d059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d23cc92-a156-4a44-8b76-f082f7c3484a", "name": "network-vif-deleted", "tag": "f9f873c9-64f4-4f0f-a61d-410318c37f4a"}]} {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:59:40.230186 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-3ecccc5e-f490-4aa4-a96b-a16d7d1fedd5 req-660f7e11-f8f0-493c-b10b-3d147885d059 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:40.231023 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [req-3ecccc5e-f490-4aa4-a96b-a16d7d1fedd5 req-660f7e11-f8f0-493c-b10b-3d147885d059 service nova] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:40.249799 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.compute.server_external_events [req-3ecccc5e-f490-4aa4-a96b-a16d7d1fedd5 req-660f7e11-f8f0-493c-b10b-3d147885d059 service nova] Creating event network-vif-deleted:f9f873c9-64f4-4f0f-a61d-410318c37f4a for instance 7d23cc92-a156-4a44-8b76-f082f7c3484a on hv-cinder-84949 Jul 18 10:59:40.257372 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [req-3ecccc5e-f490-4aa4-a96b-a16d7d1fedd5 req-660f7e11-f8f0-493c-b10b-3d147885d059 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051129 Jul 18 10:59:40.258486 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 595/1163] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 18 10:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:59:40.993281 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-b45a1b22-8c00-4247-957f-8bdc3d54f265 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:59:40.994910 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.compute.api [None req-b45a1b22-8c00-4247-957f-8bdc3d54f265 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125005) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:59:41.000381 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b45a1b22-8c00-4247-957f-8bdc3d54f265 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:41.000853 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b45a1b22-8c00-4247-957f-8bdc3d54f265 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:41.001630 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b45a1b22-8c00-4247-957f-8bdc3d54f265 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:41.002064 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b45a1b22-8c00-4247-957f-8bdc3d54f265 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:41.036510 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b45a1b22-8c00-4247-957f-8bdc3d54f265 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:41.036993 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG oslo_concurrency.lockutils [None req-b45a1b22-8c00-4247-957f-8bdc3d54f265 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125005) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:41.037487 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.objects.instance [None req-b45a1b22-8c00-4247-957f-8bdc3d54f265 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lazy-loading 'fault' on Instance uuid 7d23cc92-a156-4a44-8b76-f082f7c3484a {{(pid=125005) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:59:41.079975 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.policy [None req-b45a1b22-8c00-4247-957f-8bdc3d54f265 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5275b73fe98746879d090ab7713afd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc1cd8a20854cb0ac847cf30c1343eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125005) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:59:41.089199 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-b45a1b22-8c00-4247-957f-8bdc3d54f265 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 200 len: 1348 microversion: 2.1 time: 0.100219 Jul 18 10:59:41.095680 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 569/1164] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:59:40 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:59:42.108740 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e0410842-62c2-4a50-8c42-c6d6fc109110 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '>' {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:59:42.109850 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.compute.api [None req-e0410842-62c2-4a50-8c42-c6d6fc109110 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] [instance: 7d23cc92-a156-4a44-8b76-f082f7c3484a] Fetching instance by UUID {{(pid=125007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:59:42.116310 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e0410842-62c2-4a50-8c42-c6d6fc109110 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:42.116763 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e0410842-62c2-4a50-8c42-c6d6fc109110 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:42.117703 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e0410842-62c2-4a50-8c42-c6d6fc109110 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:59:42.118646 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG oslo_concurrency.lockutils [None req-e0410842-62c2-4a50-8c42-c6d6fc109110 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Lock "5d33ec79-71c2-4367-aeee-4165661be946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:59:42.142930 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.wsgi [None req-e0410842-62c2-4a50-8c42-c6d6fc109110 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] HTTP exception thrown: Instance 7d23cc92-a156-4a44-8b76-f082f7c3484a could not be found. Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e0410842-62c2-4a50-8c42-c6d6fc109110 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Request method failure captured: Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: request: GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a HTTP/1.1 Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept: application/json Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Accept-Encoding: identity Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Connection: close Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Length: 0 Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Content-Type: application/json Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Host: 10.222.0.49 Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Openstack-System-Scope: None Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: User-Agent: python-urllib3/1.26.9 Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Auth-Token: gAAAAABi1TyAlnYJI_cffNRYqibiwS19E8pbBNs8wb-82239fMoLD_uroO87nLeqjqBW4zEdfIzK2dx5p6ZV83aNJBiNvqdrq9J20QhP89E2g2JFOa2MCXgXJ-xQitxSj0BiTmVonqzcouzpMgfmyOFW8pQ1LmeFlIRB6E6kwchtLVT067G86zM Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Id: None Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Domain-Name: None Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Identity-Status: Confirmed Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Is-Admin-Project: True Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Id: default Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Domain-Name: Default Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Id: abc1cd8a20854cb0ac847cf30c1343eb Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Project-Name: tempest-TestMinimumBasicScenario-61130234 Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Role: reader,member Jul 18 10:59:42.146139 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Roles: reader,member Jul 18 10:59:42.148184 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc1cd8a20854cb0ac847cf30c1343eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_abc1cd8a20854cb0ac847cf30c1343eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/abc1cd8a20854cb0ac847cf30c1343eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/abc1cd8a20854cb0ac847cf30c1343eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Jul 18 10:59:42.148184 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant: tempest-TestMinimumBasicScenario-61130234 Jul 18 10:59:42.148184 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Id: abc1cd8a20854cb0ac847cf30c1343eb Jul 18 10:59:42.148184 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-Tenant-Name: tempest-TestMinimumBasicScenario-61130234 Jul 18 10:59:42.148184 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User: tempest-TestMinimumBasicScenario-61130234-project Jul 18 10:59:42.148184 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Id: default Jul 18 10:59:42.148184 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Domain-Name: Default Jul 18 10:59:42.148184 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Id: 5275b73fe98746879d090ab7713afd1e Jul 18 10:59:42.148184 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: X-User-Name: tempest-TestMinimumBasicScenario-61130234-project Jul 18 10:59:42.148184 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: method: > Jul 18 10:59:42.148184 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: exception: Instance 7d23cc92-a156-4a44-8b76-f082f7c3484a could not be found. Jul 18 10:59:42.148184 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: action_args: {'id': '7d23cc92-a156-4a44-8b76-f082f7c3484a'} Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: {{(pid=125007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d23cc92-a156-4a44-8b76-f082f7c3484a could not be found. Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:59:42.150088 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d23cc92-a156-4a44-8b76-f082f7c3484a could not be found. Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d23cc92-a156-4a44-8b76-f082f7c3484a could not be found. Jul 18 10:59:42.151992 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: ERROR nova.api.openstack.wsgi Jul 18 10:59:42.154499 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: DEBUG nova.api.openstack.wsgi [None req-e0410842-62c2-4a50-8c42-c6d6fc109110 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Returning 404 to user: Instance 7d23cc92-a156-4a44-8b76-f082f7c3484a could not be found. {{(pid=125007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:59:42.154499 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO nova.api.openstack.requestlog [None req-e0410842-62c2-4a50-8c42-c6d6fc109110 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a" status: 404 len: 111 microversion: 2.1 time: 0.044514 Jul 18 10:59:42.154499 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: [pid: 125007|app: 0|req: 596/1165] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 18 10:59:42 2022] GET /compute/v2.1/servers/7d23cc92-a156-4a44-8b76-f082f7c3484a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:59:42.159254 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: DEBUG nova.api.openstack.wsgi [None req-015743cd-a23c-4145-8e04-005ab4295348 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] Calling method '.version_select at 0x7f6364cd3d30>' {{(pid=125005) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:59:42.274391 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO nova.api.openstack.requestlog [None req-015743cd-a23c-4145-8e04-005ab4295348 tempest-TestMinimumBasicScenario-61130234 tempest-TestMinimumBasicScenario-61130234-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-388273449" status: 202 len: 0 microversion: 2.1 time: 0.119751 Jul 18 10:59:42.275102 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: [pid: 125005|app: 0|req: 570/1166] 10.222.0.49 () {58 vars in 1268 bytes} [Mon Jul 18 10:59:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-388273449 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 11:00:40.713428 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 11:00:40.714091 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Mon Jul 18 11:00:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 11:00:44.065323 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 11:00:44.065994 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Mon Jul 18 11:00:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 11:02:29.095768 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 11:02:29.096374 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Mon Jul 18 11:02:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 11:02:46.155117 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 11:02:46.155679 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Mon Jul 18 11:02:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 11:02:53.723608 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 11:02:53.724233 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Mon Jul 18 11:02:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 11:04:00.721967 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 11:04:00.722764 dv-cinder-849498-1-iscsi devstack@n-api.service[125007]: Mon Jul 18 11:04:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 11:04:04.075572 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 11:04:04.076128 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Mon Jul 18 11:04:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 11:04:31.302360 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 11:04:31.303186 dv-cinder-849498-1-iscsi devstack@n-api.service[125005]: Mon Jul 18 11:04:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!